-- Logs begin at Fri 2022-01-28 01:22:09 UTC, end at Fri 2022-01-28 02:19:47 UTC. -- Jan 28 01:48:18.571107 dv-cinder-824979-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 28 01:48:18.578378 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:48:18 2022] *** Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: nodename: dv-cinder-824979-1-iscsi Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: machine: x86_64 Jan 28 01:48:18.580365 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: clock source: unix Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: pcre jit disabled Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: detected number of CPU cores: 4 Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: current working directory: / Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: your processes number limit is 47680 Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: your memory page size is 4096 bytes Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: detected max file descriptor number: 2048 Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: lock engine: pthread robust mutexes Jan 28 01:48:18.580717 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: thunder lock: enabled Jan 28 01:48:18.581151 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 28 01:48:18.581151 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:48:18.630509 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: Python main interpreter initialized at 0x56015360c9c0 Jan 28 01:48:18.630509 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: python threads support enabled Jan 28 01:48:18.630509 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: your server socket listen backlog is limited to 100 connections Jan 28 01:48:18.630509 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:48:18.630873 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:48:18.630956 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: *** Operational MODE: preforking *** Jan 28 01:48:18.631241 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:48:18.631241 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: spawned uWSGI master process (pid: 79441) Jan 28 01:48:18.633573 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: spawned uWSGI worker 1 (pid: 79457, cores: 1) Jan 28 01:48:18.633573 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: spawned uWSGI worker 2 (pid: 79458, cores: 1) Jan 28 01:48:18.633573 dv-cinder-824979-1-iscsi devstack@keystone.service[79441]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:48:18.631448 dv-cinder-824979-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 28 01:48:23.686211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:23.686211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: from cryptography.utils import int_from_bytes Jan 28 01:48:23.686938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:23.686938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: from cryptography.utils import int_from_bytes Jan 28 01:48:23.687367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:23.687367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: from cryptography.utils import int_from_bytes Jan 28 01:48:23.687495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:48:23.687495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: from cryptography.utils import int_from_bytes Jan 28 01:48:23.735305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:48:23.735491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:48:23.735680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] command line args: [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:48:23.735854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:48:23.735940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:48:23.736050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:48:23.736135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ================================================================================ {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:48:23.736242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] command line args: [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:48:23.736322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] admin_token = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.736512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:48:23.736588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] config_dir = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.736690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ================================================================================ {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:48:23.736772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.736892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] config_source = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.736967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] admin_token = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] debug = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] config_dir = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] config_source = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] debug = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.737900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_config_append = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.738977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_dir = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_file = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_config_append = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_dir = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_file = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.739973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.740894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.741929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.742555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] publish_errors = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.743991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] publish_errors = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] standard_threads = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.744957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] standard_threads = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] use_journal = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] use_json = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] use_stderr = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] use_syslog = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] use_journal = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] use_json = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.745990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] use_stderr = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.746142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] use_syslog = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.746211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:48:23.746429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.746932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.747871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.748970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.749941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.750972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.751909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.752979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.753994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.754913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.755961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.756946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.757931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758721 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.758957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.759782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.760869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.761900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.762554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.762649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.762780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.762858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763020 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.763984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.764937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765172 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.765971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.766910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.767976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.768994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.external = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.769944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.external = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.password = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] auth.token = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.770902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.password = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] auth.token = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.771997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.772943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.773903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.774925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.775901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.776856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.777582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.778884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.779979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.780994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.781979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.782885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.783983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.784934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.785966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.786893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.787991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.788986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.789987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.790999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.791230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.791478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.791718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.791801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.791953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.792959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.793989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.794927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.795841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.796964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.797997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.798912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.799870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.800793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.801941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.802982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.803895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] role.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] role.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] role.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] role.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.804981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.805975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.806992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.807885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.808755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.809330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.809522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.809601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.809787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.809869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.810976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.811975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.812919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.813854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.814972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.815975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.816896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.connection = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.connection = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.817902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.818991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.819947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820653 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.820962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:48:23.821869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:48:23.821978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:48:23.850809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.850951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.851031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.851104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.851239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.851324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.859683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.859970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.888564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.888790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.889129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.889363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.942619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.942870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.991735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.991963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.992779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:23.993017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.144959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.145728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.169595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.169698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.169842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.169926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.170984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.182282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.182380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.194926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.195979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.196113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.196196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.196348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:48:24.213488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.213694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:48:24.214050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.214132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.214246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:48:24.214329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:48:24.214505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.214613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.214755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.214836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:48:24.215003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.215114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.215849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.215932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.216103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.216358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.226240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.226513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.226771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.226852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.227041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.227136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.227338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.227624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.235086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.235736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.238320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.238594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.238867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.238948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.239144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.239939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.240996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.241076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.241265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.241529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.267046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.267728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.268604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.268878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.269300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.269578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.274076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.274350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.274621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.274825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.275102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.275380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.282178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.282452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.283060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.283341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.286736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.287019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.287294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.287574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.287695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.287844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.287982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.288812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.289084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.289353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.289617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.306982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.307250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.308128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.308403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.311703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.312881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.315354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.315644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.316564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.316856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.320592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.321834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.324079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.325865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.328155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.328446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.328723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.329011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.329282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.329398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.329556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.329695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.330004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.330298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.330574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.330849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.348666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.348944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.349204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.349470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.350077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.350361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.350629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.350901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.357046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.358559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.360143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.360416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.361646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.361947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.363383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.363673 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.363947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.364219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.364485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.364940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.365234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.365516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.365823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.366100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.377501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.377802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.378085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.378361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.378636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.378903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.379173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.379256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.379513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.379794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.380075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.380354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.380639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.380915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.396924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.398834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.400166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.401993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.404195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.405734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.405984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.407342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.407537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.407619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.407872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.409133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.409412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.409687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.414864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.416408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.416750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.418352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.419692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.420061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.420352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.420619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.421729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.422048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.422327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.422596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.429704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.430010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.430298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.431768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.432055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.432347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.437987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.438262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.438536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.438817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.439084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.439345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.439610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.439879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:48:24.440206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.440924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.441722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.442015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.442292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.442574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.442851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.443110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.443371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.443627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:48:24.479134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56015360c9c0 pid: 79457 (default app) Jan 28 01:48:24.481723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56015360c9c0 pid: 79458 (default app) Jan 28 01:48:24.482286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc968a2-9746-4f91-9afe-5f52fc443390 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:24.482578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc968a2-9746-4f91-9afe-5f52fc443390 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:24.482853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc968a2-9746-4f91-9afe-5f52fc443390 None None] PATH_INFO: `/v3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:24.486981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Fri Jan 28 01:48:24 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:32.090354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.090908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.090908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.095905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:32.101938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.102357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.102514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.132817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG oslo_db.sqlalchemy.engines [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:32.320654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG passlib.handlers.bcrypt [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79457) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:48:32.321086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG passlib.handlers.bcrypt [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79457) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:48:32.376631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:32.378201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:32.519130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:32.665587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.699946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG oslo_db.sqlalchemy.engines [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:48:32.829718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45e534-2aa7-47bc-8d56-b4d8a4ed13e5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.834029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.834694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.834980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.835262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.843671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.898228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:48:32.898578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d31aa-67d1-489d-8989-c59109d674a0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.908422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:48:32.915029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.929223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900a255-b389-4f3e-994d-4a8769237ad8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.934250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.935343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.935630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.935916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.937397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] RBAC: Authorizing `identity:get_project(project_id=83aa2e6f27d34fe78a1b709f22247aec)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.988895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:48:32.989240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15125-0b6f-495e-ad35-428388f96ae4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.993835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:35.144190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b76ed8-4929-4c09-b0a1-56368285aea9 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.144803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b76ed8-4929-4c09-b0a1-56368285aea9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.144803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b76ed8-4929-4c09-b0a1-56368285aea9 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.149319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:35.156517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.156942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.157083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.177035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:35.179341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:35.188223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:35.213463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b76ed8-4929-4c09-b0a1-56368285aea9 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:35.225349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b76ed8-4929-4c09-b0a1-56368285aea9 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:35.229539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:35.230216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.230507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.230787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.238276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:35.240064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853a62-9fcb-4a5d-be66-a68d5b8525a5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:35.249091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:35.255036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:35.264603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19189d24-c06b-452d-9ad8-17d8f9d950d3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:35.269041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:35.269945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.270654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.270654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.271916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:35.273770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb377b-dfa9-406b-8cb8-65f635654826 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:35.275339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:35 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:37.492804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053cce9-8f3f-41a9-b803-10fa472b37c9 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.493303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053cce9-8f3f-41a9-b803-10fa472b37c9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.493511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053cce9-8f3f-41a9-b803-10fa472b37c9 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.495311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:37.502600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.503019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.503158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.508236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe32c1-5690-41ba-8fd5-670fd0c3febf None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.508528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe32c1-5690-41ba-8fd5-670fd0c3febf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.508815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe32c1-5690-41ba-8fd5-670fd0c3febf None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.510512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:37.517651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.517979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.518267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.520854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:37.522030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:37.530067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:37.554623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.560217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG passlib.handlers.bcrypt [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:48:37.560638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG passlib.handlers.bcrypt [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:48:37.563241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bab9b4-c2fc-4592-8ac6-3a7d33af9708 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.567627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.568401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.568686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.568967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.581412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:37.588145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:37.589286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 7/13] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:37.595616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.604427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3d3a4-0e13-47d2-83f7-0069963d5311 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.607380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:37.608974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:37.609333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.609948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.610237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.610517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.611244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:37.611552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.613252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:37.613252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:37.613252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:37.614203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.626595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 8/14] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:37.632273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.641382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97077a-998b-49f8-a229-a914d107da23 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.645669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.645965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 7/15] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:37.646517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.646803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.647083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.648268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.650078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.651568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 9/16] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:37.657771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.666920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084448fa-f370-4bc4-9391-e48a2c50e889 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.669602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.672160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.673261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.673556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.673927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.675386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.677413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.679212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:37.679524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd48af-d51c-4e4f-9451-edf20d045966 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.684160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.684592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.684876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.684976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.685149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.692832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.694509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc70d-cd79-4c58-84ab-6b1ef7ff8a22 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.694609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.699350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.699953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.700243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.700525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.701333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.domain.id=default, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:37.701645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.703326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:37.703326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:37.703326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:37.703731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 10/18] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:37.704473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5177b0d-3ec1-41b0-8415-1c398b5c8782 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.709353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:37.727301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1343 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.domain.id=default&role.id=570ba9cb94054cda821730576cfb0f2e => generated 233 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:37.727507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227e9e-43a3-415b-8434-1fcfffef994b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:37.727507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:37.727507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:37.727507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:37.727842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:37.727842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:37.727842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52e9e9-1286-402d-a254-1dad109818d9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:37.729053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:40.258873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e925e-f1d2-4f4e-9e56-388bb2dd7867 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.259368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e925e-f1d2-4f4e-9e56-388bb2dd7867 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.259439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e925e-f1d2-4f4e-9e56-388bb2dd7867 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.262010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:40.278481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.279848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.280661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.306647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:40.308803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:40.319997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 12/22] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:40.368928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e925e-f1d2-4f4e-9e56-388bb2dd7867 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.389414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e925e-f1d2-4f4e-9e56-388bb2dd7867 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.394411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.395580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.396075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.396581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.423374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:40.425629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:40.447416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6e980759-4bdc-4a36-9ace-da8cf896272d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:48:40.449609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 11/23] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:40.456269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.465949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c0a6-e9a8-4933-8573-1aef718d7b4a None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.466461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c0a6-e9a8-4933-8573-1aef718d7b4a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.466897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16c0a6-e9a8-4933-8573-1aef718d7b4a None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.468812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 12/24] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:40.469676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfaf5d-fed4-4e9d-ab78-1d4d47cd35e8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.480737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.480948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.481154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.481437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.482123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.482559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.482995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.483934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:40.484398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:40.485553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:40.485553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:40.485553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:40.486780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:40.505716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:40.506954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:40.507779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 13/25] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:40.514713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.519024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 13/26] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:40.525216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25547fb-e0fc-46ec-b5e1-afc41b996899 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.537129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.538024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.538456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.538914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.539802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:40.540959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:40.540959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:40.540959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:40.542544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ace47-333c-48a3-a132-ca27f1ee264b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:40.564814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.577339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08bfba-02a4-42e0-9156-a9def1b7b60f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.584735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.585981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.587689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.588205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.603921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:40.611307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2ba578b1-357a-4543-9bba-faa7bccab779 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:40.613237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 14/27] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:40.614741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7c4c-6455-4fa1-b415-69b14079ad0e None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.615232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7c4c-6455-4fa1-b415-69b14079ad0e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.615732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7c4c-6455-4fa1-b415-69b14079ad0e None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.617919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 15/28] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:40.626839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.627415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.627897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.647092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:40.648592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:40.664132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 16/29] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:40.665232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.681772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f499-0aa1-47a1-b9cd-3f9c461138fd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.689422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.690403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.690891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.691364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.692317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:40.692845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:40.694070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:40.694070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:40.694070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:40.695367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff1eb-d9fe-45ff-8e81-fb6043fbf889 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:40.709794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 17/30] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:40.711391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8600c-f27b-4026-8717-aeb374f2134a None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.711881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8600c-f27b-4026-8717-aeb374f2134a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.712353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8600c-f27b-4026-8717-aeb374f2134a None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.715050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 18/31] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:40.715929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8600c-f27b-4026-8717-aeb374f2134a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.735488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8600c-f27b-4026-8717-aeb374f2134a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:40.741124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:40.741826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.742117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.742395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.743145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:40.744155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:40.744155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:40.744155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:40.745068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:40.819772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 14/32] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/projects => generated 301 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:40.821236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:40.821538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:40.830050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:40.862650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:40.864238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:40.968524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:40.969403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:40.985383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e15214-3bc4-411a-9630-d8588055c297 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:41.000009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 19/34] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:48:40 2022] POST /identity/v3/roles => generated 219 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:41.004647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:41.005565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.005881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.006171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.010830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:41.012137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:41.012914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:41.014675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 16/35] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:40 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:41.020990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:41.024361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d58b5-bbbc-401d-826d-438f7a8b4057 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:41.029677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:41.030452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.030745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.031089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.031920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:41.033997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:41.036059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f705f-9e5f-4e19-8863-da8b6d319ff5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:41.052325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 20/36] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:48:41 2022] POST /identity/v3/roles => generated 225 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:41.054014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:41.054837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.055129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.055416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.062868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:41.064656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e43ce-5c18-4295-874c-c1350b9b5125 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:41.066821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 17/37] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:41.073764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:41.085095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ea872-4c8a-4369-a418-a31495e34903 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:41.096859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:41.097922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.098212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.098598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] PATH_INFO: `/v3/domains/default/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.102858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a75d7081782a44cc9e092a696be2ea52, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:41.104075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:41.104075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:41.104075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:41.106991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822daa7-d6a5-4d15-942c-5cc1ec9274f5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:41.134332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 21/38] 10.222.0.77 () {58 vars in 1382 bytes} [Fri Jan 28 01:48:41 2022] PUT /identity/v3/domains/default/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:41.967960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2a65-3a49-4a92-9e8d-fc3455e4312c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.968657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2a65-3a49-4a92-9e8d-fc3455e4312c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.968657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2a65-3a49-4a92-9e8d-fc3455e4312c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.970723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 18/39] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:41.978040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.978469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.978677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.996919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:41.998448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:41.999103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227557-fccf-42d3-a23d-84a5d5ed198c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.999398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227557-fccf-42d3-a23d-84a5d5ed198c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.999685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227557-fccf-42d3-a23d-84a5d5ed198c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.001438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 19/40] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:42.008542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.008834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.009117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.026189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:42.027918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:42.064340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 22/41] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:42.085629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 20/42] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:42.087690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:42.097031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cd6e5-cfb6-4d07-acf8-3db3136a415f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:42.101467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:42.102463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.102888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.103326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.104644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:42.107086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:42.109250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:42.109596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 23/43] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:42.114669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:42.118267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913fdd2-0840-4844-be50-fd0c66298b5d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:42.123575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:42.124243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.124486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5b98-fe78-44d5-b482-b3ae2b476d63 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:42.124580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.124803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.125543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:42.126758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:42.126758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:42.126758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:42.127646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5647f3-3a64-473e-afab-9c477b479ef2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:42.128879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:42.129519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.129837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.130115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.130807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:42.131792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:42.131792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:42.131792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:42.132982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441c054-bfa7-42b6-800d-479113e3585d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:42.145571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 21/44] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:48:42 2022] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:42.181832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 24/45] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:48:42 2022] POST /identity/v3/projects => generated 312 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:43.440802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5dd8e-8946-45e7-9b77-64ca87a05009 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.441340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5dd8e-8946-45e7-9b77-64ca87a05009 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.441429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5dd8e-8946-45e7-9b77-64ca87a05009 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.443198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 22/46] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:43.451060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.451468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.451755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.468972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:43.470187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:43.524950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 25/47] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:43.548341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5dd8e-8946-45e7-9b77-64ca87a05009 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:43.560775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5dd8e-8946-45e7-9b77-64ca87a05009 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:43.564944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:43.565714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.566052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.566333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.576713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:43.583347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:43.584492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 23/48] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:43.590574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:43.599458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf17d-173a-4f5b-b508-55fad15747f7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:43.603877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:43.604632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.604992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.605345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.606212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:43.606599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:43.608298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:43.616354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 26/49] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:43.622659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:43.632427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b834-3ba4-4e93-9fe4-9a9602ba2990 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:43.637729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:43.638592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.638877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.639156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.640343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:43.642205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:43.643750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 24/50] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:43 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:43.649311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:43.658719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb3587-e6f0-4eb8-a73c-32c6cebcc58c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:43.663145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:43.663923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.664218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.664504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.665672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:43.667917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fff5dd-ea0b-4e88-b3da-e177bc9ec746 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:43.669508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 27/51] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:43.676032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:43.685957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55d01-41dd-42a3-9d3c-1a8a0d552c39 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:43.690280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:43.690918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:43.691204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:43.691509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:43.692389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.domain.id=default, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:43.692707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:43.693696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:43.693696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:43.693696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:43.694875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f7e0a-87bd-4399-9542-a87e77792cf0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:43.702393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 25/52] 10.222.0.77 () {56 vars in 1343 bytes} [Fri Jan 28 01:48:43 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.domain.id=default&role.id=570ba9cb94054cda821730576cfb0f2e => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:44.374497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea66ed8-cc84-4552-ab54-18ebe43ecd18 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:44.374789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea66ed8-cc84-4552-ab54-18ebe43ecd18 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:44.375074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea66ed8-cc84-4552-ab54-18ebe43ecd18 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:44.376844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 28/53] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:44.383715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:44.384009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:44.384290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:44.402000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:44.403178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:44.410557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 26/54] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:44.436169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea66ed8-cc84-4552-ab54-18ebe43ecd18 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:44.448109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea66ed8-cc84-4552-ab54-18ebe43ecd18 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:44.452391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:44.453172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:44.453463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:44.453759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:44.454938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:44.456640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a669d-2622-4457-bdba-a0fae8d61be7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:44.458251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 29/55] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:44.463995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:44.472614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd22ce7-9670-43de-8de6-c8560207b634 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:44.476944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:44.477584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:44.477913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:44.478196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:44.478900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:44.481327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92e3b0-6573-4846-a980-85e2cb49a672 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:44.505026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 27/56] 10.222.0.77 () {60 vars in 1161 bytes} [Fri Jan 28 01:48:44 2022] POST /identity/v3/projects => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:46.671421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8796d7-2568-4101-ba72-cf722f4670a9 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:46.671924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8796d7-2568-4101-ba72-cf722f4670a9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:46.671924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8796d7-2568-4101-ba72-cf722f4670a9 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:46.673681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 30/57] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:46.680991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:46.681387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:46.681563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:46.699365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:46.700552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:46.754465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 28/58] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:46.780571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8796d7-2568-4101-ba72-cf722f4670a9 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:46.792474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8796d7-2568-4101-ba72-cf722f4670a9 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:46.796679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:46.797459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:46.797770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:46.798062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:46.799228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:46.801167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a23267-b2f2-4e59-8eb9-41ed8049682b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:46.802772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 31/59] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:46.808240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:46.817346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae9c46-d756-4c93-a7d6-f17f752d23d1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:46.821682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:46.822371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:46.822663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:46.822943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:46.824183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:46.825191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:46.825191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:46.825191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:46.826471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4746b-7f37-4757-a75f-1d82b5b999c2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:46.850305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 29/60] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:48:46 2022] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:50.062597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51a5-8baf-434f-b9f3-9b76d085f1fa None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.063617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51a5-8baf-434f-b9f3-9b76d085f1fa None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.064139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a51a5-8baf-434f-b9f3-9b76d085f1fa None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.066486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 32/61] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:50.073712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.074772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.075267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.100397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:50.102011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:50.110874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 30/62] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:50.149042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a51a5-8baf-434f-b9f3-9b76d085f1fa None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.168939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a51a5-8baf-434f-b9f3-9b76d085f1fa None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.173788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.174833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.175314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.176048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.190376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:50.197499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2a882832-3b37-4e94-8023-7745e2224839 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:50.199270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 33/63] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:50.205214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.219387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43dab-bf79-4cea-bf6d-a9237449a8fb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.230532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.231224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.231685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.231977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.232753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.233071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.234917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.238954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52095e-929a-40c2-b0c8-95aefc2e0902 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.239507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52095e-929a-40c2-b0c8-95aefc2e0902 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.239985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52095e-929a-40c2-b0c8-95aefc2e0902 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.242234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 34/64] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:50.250567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.251167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.251542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 31/65] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.253271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.259677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.280928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa48eb-0df9-435e-a09e-f339a2a8ae49 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.286604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:50.287954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:50.293248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.295459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.296526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.298275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.302864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 35/66] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:50.322305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.324849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.328783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 32/67] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.330785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.334357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.340886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688ada-f147-49d6-8c1d-e976e0399069 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.348853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a96-c93b-4ebf-93e7-8d40a2860fec admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.350270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.351328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.352462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.353312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.362918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.363963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.364826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.366037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.376666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:50.383742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:50.388183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.390331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.395623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 36/68] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:50.402620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 33/69] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:48:50.406906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.409510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.417975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a7779-3dae-4d1a-9510-23a494446fe6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.419236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd285-2a81-471b-98cd-215b405453a2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.426981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.427689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.427979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.428264 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.429041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.429358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.431109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.433952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.434848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.435136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.435417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.436751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.438940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.440737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 34/70] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:50.450260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.460094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 37/71] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.461283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dc7c-85dc-4da5-9bca-a5029b4cbe5b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.466025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.475877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.476560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.476849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.477131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.478008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.478332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.480770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.485295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc0e3-6161-439f-aee7-012972f17d8c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.491198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.492094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.492384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.492669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.496477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 35/72] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.497207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.499090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeda520-bf2d-4056-8353-6c6fe41f549c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.500922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.507510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.517886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e5f0-c2be-4b35-9f38-ffb8dc8aac9f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.518075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498a87-cdcd-4c4e-b171-7c0d0e797301 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.518513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e5f0-c2be-4b35-9f38-ffb8dc8aac9f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.518946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38e5f0-c2be-4b35-9f38-ffb8dc8aac9f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.521209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 39/74] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:50.529988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.530451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.530654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.530948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.531218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.531323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.531728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.546562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.548359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.553096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:50.554581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:50.563670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 40/75] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:50.569857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 36/76] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:50.574688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.588387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02cbd-46ce-4a78-9337-5871c0d0b4ab None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.596138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.597932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.598474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.598974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.601299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.603808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.606551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 41/77] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.612770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.623453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.624606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a09d2-bd00-41e9-a31b-b6d5e663e9c8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.633894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bce0a-6223-4374-957f-661d50163bd8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.639181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.640197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.640686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.641318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.642488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.642608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.643153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.643321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.643620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.643904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.645928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb531b2-85b5-45e1-86c2-f9212a7b3bb8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.652867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 42/78] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.670746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:50.674949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db70-b3f9-41c7-8217-2876df33509b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.675475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db70-b3f9-41c7-8217-2876df33509b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.676249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1db70-b3f9-41c7-8217-2876df33509b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.678303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 43/79] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:50.678668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-4007864a-7665-47f9-8798-6740167d2ea3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:48:50.679914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 37/80] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:50.687274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1db70-b3f9-41c7-8217-2876df33509b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.690442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.690977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.691480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.701262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1db70-b3f9-41c7-8217-2876df33509b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.706327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.708209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.708597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.708962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.709856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.710244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.711989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.725773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 44/81] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.726905 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:50.728220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:50.730957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.742206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ee42e-a563-46b9-97f7-9274d6e569c1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.747385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 38/82] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:50.749836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.750735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.751067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.751347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.752558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.754874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.756482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 45/83] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.762756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.772655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc6590-51a6-47b7-82dc-093a8a477645 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.777883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.778572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.778865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.779149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.788520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.791287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.801452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.812516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef83af9-4c3d-40d2-8ce9-aca86dcec0e8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.813632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 39/84] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:50.820566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.828389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.829140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.829425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.829701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.831499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85c27-76c4-4b29-8196-a70a0809340e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.834705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.836468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.836648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.837549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.837859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.838140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.838314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 46/85] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.839863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.842168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.844456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 40/86] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:50.844907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.851207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:50.861995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b07b2-61e5-4f95-8fd3-74a85b49ef62 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.867585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.868267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.868623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.868906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.869869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:50.870899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.872894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095cf3-bb53-42b9-9833-b663b1277cae admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:50.873103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c00a68-a109-4417-9b0b-449ac3158117 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.879864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 41/87] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:50 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=ff066e890e8f45759e7037b2a84080ab => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:50.883963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:50.884662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.885002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.885294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.886710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.888809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5661ee-04ec-413c-a7ce-c920944e0ff6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.921822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 47/88] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/projects => generated 302 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:50.941484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a02-1ba1-4384-9acf-df60e67eacd6 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.941815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a02-1ba1-4384-9acf-df60e67eacd6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.942079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a02-1ba1-4384-9acf-df60e67eacd6 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.943997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 42/89] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:50.952892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:50.953214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:50.953465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:50.973267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:50.974558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:51.041882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 48/90] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:51.079650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2a02-1ba1-4384-9acf-df60e67eacd6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.092255 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2a02-1ba1-4384-9acf-df60e67eacd6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.096694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.097510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.099358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.099677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.112198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:51.119242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:51.120573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 43/91] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:51.127156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.136746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6662259-4d6f-4f4c-b5c0-a8083506c83f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.141386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.142127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.142415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.142700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.143468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:51.143783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:51.145435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:51.156589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 49/92] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:51.162581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.174669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605fed-7ac0-474d-914d-f88d6340d920 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.179421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.180291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.180579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.180859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.182113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:51.184405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:51.186040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 44/93] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:51.192281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.202661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2d3cf-32eb-4061-9052-933ee6737c8f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.207229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.207886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.208174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.208458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.217296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:51.219105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:51.228427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 50/94] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:51.234694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.244398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd637-81e8-4a80-846a-a63f0ce258c4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.253952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.254841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.255130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.255414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] PATH_INFO: `/v3/projects/37e849972ffc41f284b0e49062648a7d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.256667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] RBAC: Authorizing `identity:get_project(project_id=37e849972ffc41f284b0e49062648a7d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:51.258774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb7dbf-ce9e-4783-bef1-c6120e8f1278 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:51.260448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 45/95] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/projects/37e849972ffc41f284b0e49062648a7d => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:51.271982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:51.281843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2621358-83c4-4c1e-a523-9dc821fd6a71 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:51.286399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:51.287061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:51.287350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:51.287634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:51.288471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=37e849972ffc41f284b0e49062648a7d, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:51.288788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:51.290811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cc276-4fd0-4179-a499-778b3a469af1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:51.296910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 51/96] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:51 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=37e849972ffc41f284b0e49062648a7d&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.201111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb4bf-208c-4c66-952c-46a2b4581735 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.201833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb4bf-208c-4c66-952c-46a2b4581735 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.201833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fb4bf-208c-4c66-952c-46a2b4581735 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.203464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 46/97] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:53.211000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.211512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.211675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.234420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:53.235673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:53.243361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 52/98] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:53.277077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb4bf-208c-4c66-952c-46a2b4581735 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.290158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fb4bf-208c-4c66-952c-46a2b4581735 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.297199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.298435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.298928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.299431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.313781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:53.321259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:53.322884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 47/99] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:53.329547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.339562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171013d-730b-4a47-ab2a-10677cfed791 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.344400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.345308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.345851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.346356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.347326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:53.347835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.349656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.359550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 53/100] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.365983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.376205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb00ea-07d5-4724-b3e0-b56e73d47ee9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.381254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.382415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.382925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.383402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.384922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.387368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9e300-fde7-4e28-bc94-33f413b81fb7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.389485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 48/101] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.395850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.406711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f77f-2b37-4118-9c3a-fd9418122d16 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.411533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.412636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.413124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.413601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.415020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.417927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.420189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 54/102] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.427273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10720-423d-4ea6-a4c6-91851a853c00 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.427790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10720-423d-4ea6-a4c6-91851a853c00 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.428274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10720-423d-4ea6-a4c6-91851a853c00 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.430273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 49/103] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:53.431312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.437602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.437917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.438202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.441604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07669d-72db-4966-a2e1-3a5662b8abc1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.446347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.447504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.448022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.449036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.451397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f118b848914748a8b0a821a6dcbff6, user_id=1e71bfb6b4004afa9162539ba9f5e8a6, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.454334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.463694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:53.465952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:53.476873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 55/104] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:53 2022] PUT /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:53.486064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 50/105] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:53.523305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.607593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28ff77-e318-4045-b7f6-db190b897ac3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.613725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.614871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.615340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.615793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.628046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:53.635395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-9fac4295-fba3-4c08-b1b8-06b658f2280d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:53.637053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 56/106] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:53.643641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.655433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b2649-90f2-4e3e-94e5-9b595657e4e3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.661127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.662092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.663995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4754-f780-43dc-a884-fc0406e28cff None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.664494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4754-f780-43dc-a884-fc0406e28cff None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.664951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c4754-f780-43dc-a884-fc0406e28cff None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.667620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 57/107] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:53.668073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.668593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.669558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:53.670119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.671957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.679249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86895-9697-4d05-a812-25741057e44c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.679545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86895-9697-4d05-a812-25741057e44c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.679832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86895-9697-4d05-a812-25741057e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.688934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 51/108] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.691809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.712321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-bbb86895-9697-4d05-a812-25741057e44c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:53.712702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5e0-5005-4548-82ce-789f2a51921d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.715751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bbb86895-9697-4d05-a812-25741057e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:53.722833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.724077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.724982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.726087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.729260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.732099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.735369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 58/109] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:53.736741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 52/110] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.744471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86895-9697-4d05-a812-25741057e44c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.755660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86895-9697-4d05-a812-25741057e44c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.760408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.761521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.762071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.762563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.763925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.766233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.768108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 59/111] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:53.774499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.777502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.786735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8aa91-0815-4e52-920d-0bbe1a5c5184 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.787074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56408059-2dfa-462b-8c8e-25af7ac6d8ac admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.791764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.792394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.792731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.793018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.793295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.794086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.794800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.795321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.795417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f118b848914748a8b0a821a6dcbff6, user_id=a75d7081782a44cc9e092a696be2ea52, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.798071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.812275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:53.815624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 60/112] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:53 2022] PUT /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:53.820793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a4e75572-8c90-4f99-8fe8-21c74bcdae8d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:48:53.822923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 53/113] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:53.835968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.923974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc01ae-0e59-4341-9726-f3c6942c897e None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.924673 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc01ae-0e59-4341-9726-f3c6942c897e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.925183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc01ae-0e59-4341-9726-f3c6942c897e None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.927656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 54/114] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:53.933807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fe4aa-7665-4ccf-a3a4-ebbe445b9d0f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.936676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.937117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.937538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.943237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.943945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.944234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.944517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:53.945299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:53.945612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:53.947362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:53.960351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:53.961894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:53.964820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 61/115] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:53.971476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:53.977166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 55/116] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:53.987072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d5432-55b9-446a-92fa-c064dc785dfd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:53.994971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:53.996445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:53.996734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:53.997014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.001191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.001585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.003444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.005250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 62/117] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:53 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:54.012414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.016983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa5de4-a579-492f-9ecd-38207f22b748 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.021604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.022482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.022758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.023045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.027063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7c47a-b0b3-4618-ba36-0491248ea925 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.035317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:54.037438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.038353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.038641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.038919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.040163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.042364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd1fa-89d1-40a6-a974-001edff17e26 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.043481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:54.044110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 63/118] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:54.045227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 56/119] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:54.045503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86adc6-72b9-455d-a614-4e9f10ff0d07 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.045815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86adc6-72b9-455d-a614-4e9f10ff0d07 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.046151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86adc6-72b9-455d-a614-4e9f10ff0d07 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.047870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 64/120] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:54.052060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.052491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86adc6-72b9-455d-a614-4e9f10ff0d07 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.066198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7ce-dcb3-423a-90f1-9212563168e3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.068025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86adc6-72b9-455d-a614-4e9f10ff0d07 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.071987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.072906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.073048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.073838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.074341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.074637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.075010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.075417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.076317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:54.076718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f118b848914748a8b0a821a6dcbff6, user_id=1e71bfb6b4004afa9162539ba9f5e8a6, role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.076818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.077876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:54.077876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:48:54.077876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:48:54.078810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92c74-6a5f-412d-b1ec-49ba8b09c2b6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.079830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.090515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 65/121] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:54.091990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.092443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.092976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.100829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 57/122] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:54 2022] PUT /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/ff066e890e8f45759e7037b2a84080ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:48:54.106009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.129286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:54.130918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:54.222018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fd5d-32e7-404b-b523-84636b6a0050 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.232613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.234175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.235016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.235843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.238659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.242190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.244991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 58/123] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:54.247287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 66/124] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:54.254982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.271125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624c46-91ea-4ab0-8d67-4ae507b3028e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.278578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.279513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.279895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.280176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] PATH_INFO: `/v3/projects/37e849972ffc41f284b0e49062648a7d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.281928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] RBAC: Authorizing `identity:get_project(project_id=37e849972ffc41f284b0e49062648a7d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.284125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.286009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 59/125] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/projects/37e849972ffc41f284b0e49062648a7d => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:54.292964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.305036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.307322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac3ee-635d-4539-b491-144d4efc7406 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.313736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.314956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.315456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.315751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] PATH_INFO: `/v3/projects/37e849972ffc41f284b0e49062648a7d/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.317071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980d7f-189f-4eb4-a8fa-0a7477b0c30a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.318512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e849972ffc41f284b0e49062648a7d, user_id=1e71bfb6b4004afa9162539ba9f5e8a6, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.321484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b2bc2-dd04-4f1b-9c8d-26395cf257f5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.322824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.323692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.323988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.324317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.325598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.327464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.329064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 60/126] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:54.335281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:54.345996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450a68a-f6e0-4fc5-a97e-070b6e521cb8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:54.350110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 67/127] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:54 2022] PUT /identity/v3/projects/37e849972ffc41f284b0e49062648a7d/users/1e71bfb6b4004afa9162539ba9f5e8a6/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:54.410364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:54.411422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:54.411902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:54.412369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:54.413412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:54.415928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8614be-3510-4926-a9a6-7b16aa6dff56 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:54.441372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 61/128] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:48:54 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:56.163307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6944-1e7c-4208-8f50-a200a9b17ff3 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.163840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6944-1e7c-4208-8f50-a200a9b17ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.163914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc6944-1e7c-4208-8f50-a200a9b17ff3 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.165649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 68/129] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:56.173352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.174431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.174931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.199465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:56.201003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:56.211604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 62/130] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:56.236459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6944-1e7c-4208-8f50-a200a9b17ff3 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.255782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc6944-1e7c-4208-8f50-a200a9b17ff3 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.265900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.266729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.267021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.267304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.294816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:56.306108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:56.309672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 69/131] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:56.314573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.328732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93286fc8-085d-4902-8b00-db198a17eeca None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.337809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.339277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.339779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.340250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.341210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:56.341767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.343605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.358348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 63/132] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:56.366467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.379850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50a73-8961-40cc-a700-b45fe1da874f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.390089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.390990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.391275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.391555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.392773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.394993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.396926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 70/133] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:56.403573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.414006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e1d21-9212-4753-b1da-2a27305ebc56 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.426698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.427375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.427668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.427951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.441608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.443432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.455470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 64/134] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:56.463717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.479004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccdd27-0b62-4b55-a45a-c8f5ad14ce16 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.490069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.490964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.491257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.491543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.492763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.499080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5210af3-5327-48eb-be72-b9fd0f50f8ae admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.501208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 71/135] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:56.508821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.523369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e896c-8fe0-4d31-96f6-fa87a220ba00 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.534405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.535091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.535384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.535669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.536520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:56.536841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.538779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab50f-903a-4e87-bf0f-2cbe416dc477 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.551167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 65/136] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:56.673362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ea42-3ed2-465a-b50b-beb034204782 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.673771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ea42-3ed2-465a-b50b-beb034204782 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.674073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8ea42-3ed2-465a-b50b-beb034204782 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.676869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 72/137] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:56.686217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.686524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.686792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.715026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:56.716273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:56.724457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 66/138] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:56.778986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ea42-3ed2-465a-b50b-beb034204782 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.796992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8ea42-3ed2-465a-b50b-beb034204782 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.803345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.804167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.804453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.804731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.822859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:56.830869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:56.832359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 73/139] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:56.840779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.855554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56487480-3338-4a1e-b188-1ad37b04283d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.867075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.867774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.868062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.868346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.869577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:56.869577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.871647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.886534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 67/140] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:56.893162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.907437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb83de-dbe9-4a31-a9c5-130bbf78dafc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.923010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.923978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.924218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.924574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.926419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.928732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63311-2120-4f59-b6e5-807c9879ab69 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.930651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 74/141] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:56.937680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:56.951423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a7cf-d51c-4225-afe7-0aaef6cf2334 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:56.958757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:56.959424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.959711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.959992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.973608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:56.975460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:56.975783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e9ce-3df2-49c5-ad74-52129118ea40 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.976082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e9ce-3df2-49c5-ad74-52129118ea40 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.976368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e9ce-3df2-49c5-ad74-52129118ea40 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.978171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 75/142] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:56.987323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:56.987607 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 68/143] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:56.987765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:56.987915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:56.996253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.010998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07ba7d-4191-446a-ae67-83e001d117eb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.011824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:57.013738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:57.028000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.028883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.029173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.029458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.030571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 76/144] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:57.034529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.036611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.038344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 69/145] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:56 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:57.045521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.058929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e102ea-0c8e-4ef3-b1c0-03050cf55b82 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.069924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.070609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.070898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.071177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.072029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:57.072344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.074317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.086746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 77/146] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.090812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.112610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff50a-5eb6-4092-9622-bd7b8f5ebee3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.122141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.122982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.123275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.123559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.147626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:57.155549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:48:57.156829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 70/147] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:57.163569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.177519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7480c51-660f-4bca-9122-db7c17b746f7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.191371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.192069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.192360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.192643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.193406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:57.193719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.195397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.212206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 78/148] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.219207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.235558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fda54-621f-4308-bfd3-77d53ea11a76 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.246435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.247357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.247651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.247938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.250635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.252880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.254662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 71/149] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.261788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.274854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d92b92-4c84-4760-8225-7d9b37ee4239 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.291512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.292239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.292530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.292810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.306206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.308039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87eeb-544a-4936-a41d-5832cfe8b864 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.324403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 79/150] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:57.330981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.346909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8e74-3dd6-4155-8f95-19566133f2df admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.359067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.359942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.360234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.360522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.366643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.368778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.369179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934310-3fe3-4830-96a5-c4b4f16fd2a0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.369478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934310-3fe3-4830-96a5-c4b4f16fd2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.369785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f934310-3fe3-4830-96a5-c4b4f16fd2a0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.370618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 72/151] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.371605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 80/152] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:57.377669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.389662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.390023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.390257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.391430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa863f-37c7-412f-a019-4ca948c9faed admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.400573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.401331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.402155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.402440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.403285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=c7f118b848914748a8b0a821a6dcbff6, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:57.403603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.405472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.414755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 73/153] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=ff066e890e8f45759e7037b2a84080ab => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.415629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:57.416945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:57.434285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 81/154] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:57.476769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.491158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa92e7-775e-4854-9b0e-9bebdd585079 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.499485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.500324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.500613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.500896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.518815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:57.525920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:57.527742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 74/155] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:57.534518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.547392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e479d-34e4-4917-8af4-f27b0f9c444a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.557206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.557994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.558280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.558557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.559350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:57.559639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.561259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.574751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 82/156] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.582126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.595601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3736-39ec-4451-9256-0cdf8672aa04 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.606763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.607682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.607966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.608246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.614716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.616949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.618744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 75/157] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.625428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.643147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e614bb2-1533-481d-9f86-d8b137f5f7c5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.659528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.660274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.660562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.660838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.677825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.679620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.694878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 83/158] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:57.701272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.719339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fc0ab-a6e1-4b92-a0d7-304f08b084ba admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.730644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.731533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.731822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.732104 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] PATH_INFO: `/v3/projects/37e849972ffc41f284b0e49062648a7d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.734583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] RBAC: Authorizing `identity:get_project(project_id=37e849972ffc41f284b0e49062648a7d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.736734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554c72-5348-4ae1-9b59-cd40617c3293 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.738621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 76/159] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/projects/37e849972ffc41f284b0e49062648a7d => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:57.745688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:57.759116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83672718-8899-493c-ae30-9881e9b2e652 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:57.766008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:57.766689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:57.766972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:57.767255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:57.768094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=37e849972ffc41f284b0e49062648a7d, user.id=1e71bfb6b4004afa9162539ba9f5e8a6) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:57.768410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:57.770324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae55d-734c-4d98-9658-1fe6c621844f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:57.782831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 84/160] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:57 2022] GET /identity/v3/role_assignments?user.id=1e71bfb6b4004afa9162539ba9f5e8a6&scope.project.id=37e849972ffc41f284b0e49062648a7d&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:58.816472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b40-6209-45ad-b518-f10d3ec98771 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.816969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b40-6209-45ad-b518-f10d3ec98771 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.817068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b40-6209-45ad-b518-f10d3ec98771 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.818834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 77/161] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:58.826500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.826930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.827117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.844539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:58.845736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:58.853428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 85/162] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:58.881146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138b40-6209-45ad-b518-f10d3ec98771 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:58.893349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138b40-6209-45ad-b518-f10d3ec98771 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:58.897690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:58.898543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.898823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.899095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.909245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:58.916094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:48:58.917933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 78/163] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:58.924312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:58.934139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8151526-6bd0-4d66-8200-cfcb84acff48 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:58.938663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:58.939338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.939622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.939901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.940647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:58.940953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:58.942579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:58.951133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 86/164] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:48:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:58.957018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:58.966872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce2401-fd04-47f3-a1cf-c1f8e15bc34c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:58.971292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:58.972163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.972447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.972725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.987102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:58.989310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:58.991018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 79/165] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:58 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:58.997620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.007264 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d72333-a3ee-4f73-9c27-ce874dad54ec admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.012315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.012984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.013270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.013549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.022392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.024191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.034838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 87/166] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:59.044290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.054721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f30f5-d833-4645-83a1-14f67e4807d8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.059915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.060793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.061076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.061356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.062583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.064656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2032-b6c9-41c5-9109-bb95fd0bf30a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.066349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 80/167] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.072886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.082365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ef55-611d-44c9-8978-3eb469cdb5ba admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.086814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.087470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.087754 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.088029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.088886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=aaa2e518b932437eacf97c60fa278f8b) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:59.089201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.091075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409750aa-c144-4ae5-8205-4ceb688ee237 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.096729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 88/168] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/role_assignments?user.id=aaa2e518b932437eacf97c60fa278f8b&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.133697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa8c2-2f3a-426c-ad46-b9fe038b57b3 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.133697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa8c2-2f3a-426c-ad46-b9fe038b57b3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.133697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa8c2-2f3a-426c-ad46-b9fe038b57b3 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.136111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 81/169] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:59.144176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.144864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.145352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.164893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:59.166508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:59.176427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 89/170] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:59.202007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa8c2-2f3a-426c-ad46-b9fe038b57b3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.215274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa8c2-2f3a-426c-ad46-b9fe038b57b3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.220184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.221367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.221937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.222410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.235575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:59.242990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:59.244562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 82/171] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:59.251903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.262492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7b8b-5955-403d-9282-9452c78ed46e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.267579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.268696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.269175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.269645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.270667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:59.271230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.273232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.285220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 90/172] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.292652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.304509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214ec48-4458-4d04-84f3-f7b65a975030 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.310838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.312086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.312755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.313284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.314955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.317096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901db90-4350-49f7-ac46-67d869c3c4eb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.319090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 83/173] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.325666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.336131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6432b-2fa4-4b30-a399-95756096bf5a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.341911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.343027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.343610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.344085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.354039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.356796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.367925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 91/174] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:59.373494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c91cae-9d37-4b44-9621-13f0c3ce9176 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.373865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c91cae-9d37-4b44-9621-13f0c3ce9176 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.374159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c91cae-9d37-4b44-9621-13f0c3ce9176 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.376094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 84/175] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:59.379083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.384316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4bcd-ae1e-4d92-8382-2eaebb7b7659 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.384842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4bcd-ae1e-4d92-8382-2eaebb7b7659 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.385319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4bcd-ae1e-4d92-8382-2eaebb7b7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.388666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd280b0-88c8-4557-8d24-3810a3f47294 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.394252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.395108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.395391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.395663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.396852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.398939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.401777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 92/176] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.408079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.410586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c47e4bcd-ae1e-4d92-8382-2eaebb7b7659 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:59.412041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c47e4bcd-ae1e-4d92-8382-2eaebb7b7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:59.418205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3c2c-8d84-4acd-911a-198ab68753b8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.421095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 85/177] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:59.426052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.426052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.426052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.426052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.426357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:59.426357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.427187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.433014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 93/178] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:59.444572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c4db-448d-4c24-8ba3-632b51642cd1 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.445199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c4db-448d-4c24-8ba3-632b51642cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.445703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c4db-448d-4c24-8ba3-632b51642cd1 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.447934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 86/179] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:48:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:59.452857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.457051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.457686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.458211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.466633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce103edf-97a9-40b8-ba0a-e60471e1f52b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.471228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.472049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.472345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.472627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.473925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.475649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.477659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 94/180] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.482583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:59.484080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:59.484501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.494305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 87/181] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:59.498459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbbc58-b48b-43b9-832a-b77ae499f2bd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.503788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.504793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.505280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.505864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] PATH_INFO: `/v3/groups` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.506835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.508207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:59.508207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:48:59.508207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:48:59.509961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.519894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.533466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321858ee-a479-469c-9bf3-235d015febe3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.538867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.540034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.540593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.541090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.546268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 95/182] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 01:48:59 2022] POST /identity/v3/groups => generated 229 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:59.557813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:59.566045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:48:59.567769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 88/183] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:48:59.575319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.586584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c048bc3-4917-407f-b073-056093c287e1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.592389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.593529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.594048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.594547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.595588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:59.596121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.598239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.609390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 96/184] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.615972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.627033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc25dc-9ba6-440d-a673-6137880ef99a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.631634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.632522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.632803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.633080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.634418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.636642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.638418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 89/185] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:59.644832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.655727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a228ba-5d04-4091-8262-5d5db014d713 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.660452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.661165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.661544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.661858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.671492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.673376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.684308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 97/186] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:59.690661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.701737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a765-e921-403c-b7c6-4ae637d90fd7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.706405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.707331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.707612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.707939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.709236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.711512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b24b11-3ab7-47f2-b09e-e799d1e035b9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.713327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 90/187] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:59.720150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:59.730217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de7b0d-e5f6-4536-acd1-095d128a0465 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:59.734861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:59.735577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:59.735863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:59.736142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:59.736975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=aaa2e518b932437eacf97c60fa278f8b) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:59.737279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.739281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2341e-42da-461f-ba40-3418aabdeef5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.745984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 98/188] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:59 2022] GET /identity/v3/role_assignments?user.id=aaa2e518b932437eacf97c60fa278f8b&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=ff066e890e8f45759e7037b2a84080ab => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.288793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47b773-2658-42d2-8b53-a2660b8daee8 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.289724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47b773-2658-42d2-8b53-a2660b8daee8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.290266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47b773-2658-42d2-8b53-a2660b8daee8 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.292260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 91/189] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:01.299930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.300349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.300556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.319033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:01.320222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.328954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 99/190] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:01.351890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47b773-2658-42d2-8b53-a2660b8daee8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.364190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47b773-2658-42d2-8b53-a2660b8daee8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.368665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.369454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.369737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.370573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.381137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:01.388517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:01.389824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 92/191] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:01.396240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.408685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff648cd1-def2-4419-b86b-1711dfea5f67 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.418683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.419635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.420090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.420537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.421459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:01.421990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.423759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.433701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 100/192] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.445783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.449903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c60fe8-971b-42bb-a2f1-7fdf435547dc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.456303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.457657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.458016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.458343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.459685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.462094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.464125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 93/193] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.470326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.480051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c277241-2bbd-445a-83db-c5760ef11f37 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.484485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.485347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.485627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.485942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.487133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.489186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13abf-4f2d-4b30-9ed0-16b44e5a6ffe admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.491287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 101/194] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.498149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.508315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb983f9-0dd8-4d3e-bd11-3e8d11fff3df admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.513278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.514206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.514485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.514759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346/users/aaa2e518b932437eacf97c60fa278f8b/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.516718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6137b31db374b6ba2f413c885d90346, user_id=aaa2e518b932437eacf97c60fa278f8b, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.519390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63624d7-5da4-4944-864a-ffcf532138d7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.536681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 94/195] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:01 2022] PUT /identity/v3/projects/a6137b31db374b6ba2f413c885d90346/users/aaa2e518b932437eacf97c60fa278f8b/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:01.680886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b8d6-9901-4284-9802-885ec759d98c None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.681250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b8d6-9901-4284-9802-885ec759d98c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.681437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b8d6-9901-4284-9802-885ec759d98c None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.684115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 102/196] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:01.692951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4780b-a51f-49c3-8731-0d1add3e6035 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.693869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4780b-a51f-49c3-8731-0d1add3e6035 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.694532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4780b-a51f-49c3-8731-0d1add3e6035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.716641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1fe4780b-a51f-49c3-8731-0d1add3e6035 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:01.719054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1fe4780b-a51f-49c3-8731-0d1add3e6035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.787139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 95/197] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:01.811738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b8d6-9901-4284-9802-885ec759d98c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.828088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b8d6-9901-4284-9802-885ec759d98c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.831421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3927df-89fc-41a3-9b08-5b20bf1a560c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.831706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3927df-89fc-41a3-9b08-5b20bf1a560c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.831986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3927df-89fc-41a3-9b08-5b20bf1a560c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.832866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.833901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.834003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 96/198] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:01.834072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.834410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.840913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.841199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.841472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.846298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:01.855621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:01.857164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 103/199] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:01.862760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:01.862760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.864044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.869161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 97/200] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:01.876050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dc58-b390-4101-a741-f2710142db50 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.880859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.881977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.882509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.883003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.884072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:01.884586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.886605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.893128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.896800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 104/201] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.903570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de995824-2f96-4561-89b9-b0e3c756d1f5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.904057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.908300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.909153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.909436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.909708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.910998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.912756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.914446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 98/202] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:01.917866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2153-35f1-484e-a33c-90685b932c1f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.921216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.923209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.924396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.924870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.925396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.927124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.929274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.931114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 105/203] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.933787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1d01-7646-4dce-aa05-331127a4e6b6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.938041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.940028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.940847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.941308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.941719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] PATH_INFO: `/v3/groups` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.942656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.943892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:01.943892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:01.943892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:01.945395 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.948757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28377c-7551-4b06-9a5c-5b4a0f615449 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.955286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.956160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.956438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.956709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.959733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.963041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f1d9f-5d70-401d-b072-5e9fbdbf318a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.965690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 99/204] 10.222.0.77 () {60 vars in 1155 bytes} [Fri Jan 28 01:49:01 2022] POST /identity/v3/groups => generated 226 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:01.969929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 106/205] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:01.971893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.982654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9718-5387-42c5-b459-9d38c8b23991 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.987514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.988598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.988933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.989214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.990366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e41a-ca9c-4499-a613-9399ef1e0300 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.990832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e41a-ca9c-4499-a613-9399ef1e0300 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.991117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e41a-ca9c-4499-a613-9399ef1e0300 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.991425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6137b31db374b6ba2f413c885d90346, user_id=a75d7081782a44cc9e092a696be2ea52, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.992917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 107/206] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:01.994236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:02.001936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.002471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.002854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.011456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 100/207] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:01 2022] PUT /identity/v3/projects/a6137b31db374b6ba2f413c885d90346/users/a75d7081782a44cc9e092a696be2ea52/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:02.023364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:02.024761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:02.100573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 108/208] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:02.124996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:02.137816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082c02-6761-4aa8-8310-58664acb6506 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:02.143105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:02.144345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.144874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.145342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.158828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:02.167468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:02.169217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 101/209] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:02.176051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:02.191193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a47bc8-d38d-4b94-8a24-a10ec28885e5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:02.196531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:02.197229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.197512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.197813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.198634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:02.198943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:02.200593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:02.211455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 109/210] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:02.218061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:02.228877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7193e-7fa8-4265-a6e4-44a21f46d993 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:02.234357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:02.235625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.236099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.236635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.238381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:02.240525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:02.242360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 102/211] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:02 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:02.248361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:02.258144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba89ef-c2f2-4beb-a25a-1d7d8cd5d455 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:02.263052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:02.263967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.264244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.264515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.265738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:02.269075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a5762-9711-4e26-a6e9-59b9a59431db admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:02.270415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 110/212] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:02 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:02.276881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:02.286688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8123ec-9bd7-410a-98a9-c1d1ace6b4c2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:02.291187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:02.292657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:02.292992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:02.293268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346/users/aaa2e518b932437eacf97c60fa278f8b/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:02.295634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6137b31db374b6ba2f413c885d90346, user_id=aaa2e518b932437eacf97c60fa278f8b, role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:02.298502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf1e6-efff-4efd-aeae-b9c00e0cb2ff admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:02.315994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 103/213] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:02 2022] PUT /identity/v3/projects/a6137b31db374b6ba2f413c885d90346/users/aaa2e518b932437eacf97c60fa278f8b/roles/ff066e890e8f45759e7037b2a84080ab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:04.027648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d8bd-fb49-42b4-aa44-108c052527ba None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.028349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d8bd-fb49-42b4-aa44-108c052527ba None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.028349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d8bd-fb49-42b4-aa44-108c052527ba None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.031755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 111/214] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:04.044168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.044645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.044714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.064606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:04.065838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:04.131540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 104/215] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:04.173244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d8bd-fb49-42b4-aa44-108c052527ba None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.188065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d8bd-fb49-42b4-aa44-108c052527ba None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.192556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.193357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.193638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.193964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.208181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:04.215115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:04.216316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 112/216] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:04.222718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.232396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e76f8-2f09-46c3-b6b3-0d02bc0eae85 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.236910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.237583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.237906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.238189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.238935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:04.239242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.240843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.257202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 105/217] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:04.263859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.275066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77ab2-2a94-46bb-8a52-d33ee6dfb1cd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.282734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.283561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.283847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.284123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.285327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.287515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.289122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 113/218] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:04.295427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.308732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6454a3-9ed7-49a1-afa4-be6fafd29c47 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.313660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.314341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.314621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.314898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.326530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.328308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.339630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 106/219] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:04.345871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.358791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4802b4-9ece-4e13-9cdc-09a6382f63dd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.363381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.364247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.364525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.364801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.370954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.373018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2872-e8b4-4a80-8937-10f9983209fd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.375069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 114/220] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:04.381773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.391817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10568-0e73-4378-8c01-debe6dc0de9e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.396809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.397480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.397770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.398063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.398891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] RBAC: Adding query filter params (role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=aaa2e518b932437eacf97c60fa278f8b) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:04.399202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.401587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82099c8-5953-4bbc-b1f5-dc9158760a9d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.409670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 107/221] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/role_assignments?user.id=aaa2e518b932437eacf97c60fa278f8b&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:04.888098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44b8c-2c28-4d7f-aee9-aa7e9d8c57e7 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.888489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44b8c-2c28-4d7f-aee9-aa7e9d8c57e7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.888655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44b8c-2c28-4d7f-aee9-aa7e9d8c57e7 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.890690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 115/222] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:04.899111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.899397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.899678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.918991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:04.920869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:04.933204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 108/223] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:04.962494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44b8c-2c28-4d7f-aee9-aa7e9d8c57e7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.976445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44b8c-2c28-4d7f-aee9-aa7e9d8c57e7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.980864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.981668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.981982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.982260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.996232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:05.003355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:05.004822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 116/224] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:05.011714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.021109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e453c-21e9-44a5-a4ef-f5f3edb4b019 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.027349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.028057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.028339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.028613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.029385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:05.029690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.031374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.042953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 109/225] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:05.049077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.062833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606298-33c8-4ec0-893c-63f3f42e1c4f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.068203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.069082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.069370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.069650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.070895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.072709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec0cfe-4a71-4794-9b7f-8f254374e5d1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.075139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 117/226] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:05.081003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.093334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98856ea4-4455-4440-b422-06279384ab46 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.098058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.098766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.099050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.099332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.111998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.113966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.125032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 110/227] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:05.131183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9ea1-0fc0-46a4-9896-1a3cacdfcb29 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.131452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.131615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9ea1-0fc0-46a4-9896-1a3cacdfcb29 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.131770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef9ea1-0fc0-46a4-9896-1a3cacdfcb29 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.133505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 118/228] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:05.142555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7d1a-94e4-4fee-acc6-99c76b56049a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.144107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.144402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.144683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.148988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.149936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.150275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.150555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.151859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.154036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.155753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 111/229] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:05.162163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.172839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:05.174074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:05.174483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e975f3-cdbd-47c5-ab54-ee9029cb3692 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.183931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.184761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.185185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.185518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.186479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=a75d7081782a44cc9e092a696be2ea52) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:05.186853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.188858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.196785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 119/230] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:05.200703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 112/231] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/role_assignments?user.id=a75d7081782a44cc9e092a696be2ea52&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:05.247380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.264572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5165b0b-b813-4aeb-aa03-8b308dd52fa8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.277026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.277883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.278168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.278443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.299656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:05.307006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:05.309091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 120/232] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:05.315570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.335047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7e793-968b-455a-ab6d-a29c89927581 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.346137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.346828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.347150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.347447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.348230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:05.348553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.350311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.368171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 113/233] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:05.375032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.387892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5f75b-1477-4989-a246-c3bb3e453b32 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.405979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.406580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.406846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.407112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.417232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.427919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.438804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 121/234] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:05.445110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.465299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db9caa-46f5-410a-a329-d0f1ff7e3079 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.475499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.476441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.476722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.477004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.478412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.481252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.483405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 114/235] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:05.489924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.499566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92a1f6-e57a-4a9a-9d69-5672538be41c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.508785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.509661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.509967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.510277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.526777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.527822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:05.527822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:05.527822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:05.529026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d006e-12a1-4898-b33b-a450fca2e8e6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.530972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 122/236] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:05.537728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:05.551716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9afd3a-e375-433e-b715-2c8ee24cff42 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:05.562063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:05.562736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:05.563079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:05.563358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:05.564200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=c7f118b848914748a8b0a821a6dcbff6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:05.564566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:05.566507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f5ada-45fc-48c5-bb89-ae79f78ba887 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:05.574748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 115/237] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:05 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:06.080526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612b81-9f6c-45c9-a71e-a01540795828 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.081207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612b81-9f6c-45c9-a71e-a01540795828 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.081207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612b81-9f6c-45c9-a71e-a01540795828 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.083526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 123/238] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:06.103244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.103868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.103868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.130232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:06.131429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:06.134337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408161-3a8b-4f68-b418-b3404c587464 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.134625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408161-3a8b-4f68-b418-b3404c587464 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.134909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408161-3a8b-4f68-b418-b3404c587464 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.137507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 124/239] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:06.144795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.145082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.145366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.147698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 116/240] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:06.179445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:06.180633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:06.191221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.191494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 125/241] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:06.203087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb443a08-19f3-4afb-943e-40581f2560e0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.209958 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.210767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.211046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.211318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.226462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.231613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:06.239213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e4e0-cf56-40f6-9c25-e204b9b423f0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.239775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:06.240984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 117/242] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:06.246371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.247196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.247644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.247808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.248352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.263220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4f442-d522-47ee-b17e-adc21eab6325 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.268991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.269251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:06.269660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.269993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.270271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.271016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:06.271319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.272930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.280789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:06.282132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 126/243] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:06.282708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 118/244] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:06.288498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.290741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.304340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f8be2-3673-4942-a180-b8b72cd265af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.308969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033fb79-2d40-4c2c-bf2d-fb92103d9ff0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.315791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.316514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.316798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.317075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.317960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.318148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:06.318304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.318900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.319188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.319468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.319915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.324832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.327042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.328936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 127/245] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:06.335143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 119/246] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:06.335689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.341712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.355520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f007-4629-4ad0-b7c7-7d568d66479c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.356481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8659-e202-40f7-842d-e372b379ff7c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.361687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.362371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.362703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.362981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.366391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.367058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.367341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.367618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.377770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.379584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.382888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.384662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.393034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 120/247] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:06.399344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.405152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 128/248] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:06.410751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4fb0-f2b6-4400-838d-eea19894d012 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.412021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.421390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.422908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.423193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.423807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.425016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.425686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8098-5252-4939-b947-89c5dd5b2559 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.429785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.431783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 121/249] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:06.438556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.442422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.443315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.443594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.443866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.445089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.447165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.448882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 129/250] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:06.453044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58310b7e-eaf9-4747-a549-e3f079e1990b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.455808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.459702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.460600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.461130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.461466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.466566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.468249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:06.468249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:06.468249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:06.469799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.470632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57033-0325-41eb-85f5-c5491bb984f4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.471489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 122/251] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:06.477928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:06.487743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.488410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.488692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.488970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.489826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=a6137b31db374b6ba2f413c885d90346, user.id=aaa2e518b932437eacf97c60fa278f8b) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:06.490143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.491974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66d40b-f89f-4950-90ba-b738ed878187 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.495560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c57279-57a7-40fc-8999-224786daf629 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:06.503008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 130/252] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/role_assignments?user.id=aaa2e518b932437eacf97c60fa278f8b&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=ff066e890e8f45759e7037b2a84080ab => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:06.503225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:06.503931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:06.504309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:06.504587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:06.505419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=c7f118b848914748a8b0a821a6dcbff6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:06.505854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:06.508107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4524e0a-ea8b-40a2-bc3c-ab07485bb78b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:06.518739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 123/253] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:06 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=ff066e890e8f45759e7037b2a84080ab => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:07.250716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1638-fdaa-4f5b-915d-fdb9bfd86ae0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.251396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1638-fdaa-4f5b-915d-fdb9bfd86ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.251396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1638-fdaa-4f5b-915d-fdb9bfd86ae0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.253177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 131/254] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:07.260847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.261402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.261402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.285523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:07.286804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:07.300256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 124/255] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:07.344080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c1638-fdaa-4f5b-915d-fdb9bfd86ae0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.360049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c1638-fdaa-4f5b-915d-fdb9bfd86ae0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.370374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.371184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.371466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.371743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.382469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:07.389296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:07.390508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 132/256] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:07.396914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.406518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9baed4-2720-48c3-8c8d-17ebcba6efe5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.413824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.414507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.414790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.415069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.415827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:07.416217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:07.418308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:07.433663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 125/257] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:07.440006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.449803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038f7a-d4d4-4fcd-8da9-027da9ba5241 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.457429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.458102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.458387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.458673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.473920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:07.475680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:07.491270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 133/258] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:07.497701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.507537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2a06-472a-48b4-8b4e-6f448c049e90 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.516972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.517852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.518137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.518414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.519626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:07.521659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:07.523352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 126/259] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:07.530110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.539081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b82a2-d4bc-4ebb-a3fe-60dabf97c30d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.546301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.547178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.547462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.547739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.548949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:07.551146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e9b28-22de-48cf-9a9f-d0c0da5c3f59 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:07.552743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 134/260] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:07.559162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:07.572488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c96f-562b-4768-ae1b-76feaff6d5e0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:07.577432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:07.578190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:07.578477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:07.578756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:07.579658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=a6137b31db374b6ba2f413c885d90346) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:07.579973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:07.581921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d5fc4-45ee-4e0c-9ff0-0d328e9796bb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:07.588211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 127/261] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:07 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.070132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e991-adf6-4c31-b11e-4a70c4991bd4 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.070506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e991-adf6-4c31-b11e-4a70c4991bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.070669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e991-adf6-4c31-b11e-4a70c4991bd4 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.072748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 135/262] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:08.091817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.092132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.092367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.171449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f00a5-8dbd-444c-954f-667bd13a37b3 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.171763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f00a5-8dbd-444c-954f-667bd13a37b3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.172002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f00a5-8dbd-444c-954f-667bd13a37b3 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.176246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 136/263] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:08.182629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.182629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.182629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.214871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:08.216452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:08.237187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 137/264] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:08.237366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:08.238391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:08.252286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 128/265] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:08.267914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.278357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85981be4-a31e-4088-9e9f-6a36932ddf6c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.287352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.288168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.288453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.288728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.290384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.301392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42efcf-5066-46ec-a215-e1b1bc0fc075 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.310998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.311828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.312115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.312393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.317050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:08.328548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:08.329707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 138/266] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:08.335248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:08.342505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:08.343717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 129/267] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:08.349720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.355556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.364940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33f06-01ef-44c1-8618-06b82e08e3ca admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.373173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.373877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.374164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.374446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.375199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:08.375511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.377113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.380639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ade72-75d9-4c70-b073-627febcaa3c9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.390832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.391514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.391800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.392077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.392827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:08.393136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.394767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.399438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 139/268] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.405759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.407663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 130/269] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.415449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.417595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c95c3-f0d3-4754-87e5-d9543bdcdb48 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.422575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.423237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.423523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.423800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.433769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344571-e036-4bbb-a52a-0c33e1f2f51d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.437122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.439238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.445942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.446607 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.446896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.447175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.457988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 140/270] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:08.460073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.461859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.464674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.477887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57fef8-adc8-467a-b7a0-fe13dc87b237 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.481670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 131/271] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:08.489816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.490685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.490970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.491252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.492446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] RBAC: Authorizing `identity:get_project(project_id=83aa2e6f27d34fe78a1b709f22247aec)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.494269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.497862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 141/272] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.499198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.508384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96647331-3bca-4b20-8972-197b4ee2c452 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.509895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.519381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.520234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.520519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.520795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.521204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079859-2581-4bb0-98e7-f0b9ae732a8b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.522077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.524150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.532382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 132/273] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.533663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.539305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.540172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.540453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.540726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] PATH_INFO: `/v3/groups/0740e2a3513b4be781ab840276c6b4ca` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.545443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91825e3-a5b8-4e16-95fe-0ce9e36927f8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.550077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.551269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.551554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.551828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.553008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.554595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] RBAC: Authorizing `identity:get_group(group_id=0740e2a3513b4be781ab840276c6b4ca)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.554949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.556501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.559056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 142/275] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/groups/0740e2a3513b4be781ab840276c6b4ca => generated 229 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.562106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 133/275] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.565446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.571285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.583186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01aef3-28b3-4259-9858-97807637f159 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.586359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb372f-300c-47eb-b41e-4830a04b8d5a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.592911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.593569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.593884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.594167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.595005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] RBAC: Adding query filter params (group.id=0740e2a3513b4be781ab840276c6b4ca, role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=83aa2e6f27d34fe78a1b709f22247aec) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:08.595319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.597167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabca6d4-cfdb-4db9-a95e-2341686002c4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.600206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.600874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.601156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.601432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.602286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=a6137b31db374b6ba2f413c885d90346) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:08.602598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.604956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8b072-9b36-46eb-927b-48f3a41a1caf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.613106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 134/276] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/role_assignments?group.id=0740e2a3513b4be781ab840276c6b4ca&scope.project.id=83aa2e6f27d34fe78a1b709f22247aec&role.id=570ba9cb94054cda821730576cfb0f2e => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.614744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 143/277] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=ff066e890e8f45759e7037b2a84080ab => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:08.762793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58bdc-0997-48fd-8f9c-1f51874be7b6 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.763135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58bdc-0997-48fd-8f9c-1f51874be7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.763349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58bdc-0997-48fd-8f9c-1f51874be7b6 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.765576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 135/278] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:08.773372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.773688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.774143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.799213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:08.800635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:08.817126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 144/279] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:08.840916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58bdc-0997-48fd-8f9c-1f51874be7b6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.853541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58bdc-0997-48fd-8f9c-1f51874be7b6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.858440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.859251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.859530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.859802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.872264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:08.879367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:08.880947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 136/280] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:08.887886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.897300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5389-fc39-4349-a194-7cd5949db09a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.906959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.907642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.907923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.908195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.908978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:08.909279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.910926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.919852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 145/281] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.926310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.937198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f347-87e2-48bf-8e58-fb00b7ce8d70 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.942377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.943225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.943503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.943778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.944940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.946863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.949298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 137/282] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.955412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.965435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17660bb-ea9f-4341-8488-49935e3f9bf6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.970165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.971028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.971362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.971640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:08.972833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:08.975082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f119-229b-43bf-a00d-0c32776ea04a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:08.977067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 146/283] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:08 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:08.983719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:08.993476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d95c-f63a-46a5-8735-8ea0d3ad4761 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:08.998556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:08.999438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:08.999720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:08.999997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.001991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f118b848914748a8b0a821a6dcbff6, group_id=d40db8b584544759bc9a8dc856e8fb0f, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.004676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a3f16-abab-42ab-85a6-a75c558f3964 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.019814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 138/284] 10.222.0.77 () {58 vars in 1463 bytes} [Fri Jan 28 01:49:08 2022] PUT /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:49:09.529779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ff29-900e-45c1-bc7f-5a1194f90a43 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.529779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ff29-900e-45c1-bc7f-5a1194f90a43 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.529779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1ff29-900e-45c1-bc7f-5a1194f90a43 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.529779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 147/285] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:09.542125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.542125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.542125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.560911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:09.565530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:09.629245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 139/286] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:09.655884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1ff29-900e-45c1-bc7f-5a1194f90a43 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.669471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1ff29-900e-45c1-bc7f-5a1194f90a43 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.674107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.675145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.675633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.676377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.687718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:09.695096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:09.696507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 148/287] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:09.703616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.712963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298f10f-e96d-43d8-9e88-b0d9093299c1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.717740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.718660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.719146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.719624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.720585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:09.721091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.722910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.732081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 140/288] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:09.738235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.750085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edee74-2eb2-48b8-8e3d-656fd54213f0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.759480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.760896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.761177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.761451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.765526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.767490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.769410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 149/289] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:09 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:09.775633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.791274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312f8b9-4e61-461f-b073-1709ab83ce81 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.797974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.799170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.799647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.800161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.801886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.804311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0692bc-eb2c-461e-ab46-17166eaa3d3a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.806684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 141/290] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:09 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:09.813478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.824044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efbb8-1029-4ac0-b184-6d8514ac1394 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.828898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.830131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.830658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.831124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.833598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f118b848914748a8b0a821a6dcbff6, group_id=d40db8b584544759bc9a8dc856e8fb0f, role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.836576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ca18a-c2fe-48fe-a3b4-23fffcb9967c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.853969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 150/291] 10.222.0.77 () {58 vars in 1463 bytes} [Fri Jan 28 01:49:09 2022] PUT /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/ff066e890e8f45759e7037b2a84080ab => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:10.294026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed1b9-35c7-4a3e-ad4c-c2915928b7c0 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.294647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed1b9-35c7-4a3e-ad4c-c2915928b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.295120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ed1b9-35c7-4a3e-ad4c-c2915928b7c0 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.297119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 142/292] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:10.305190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.305619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.305948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.328665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:10.329904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:10.410386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 151/293] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:10.447326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed1b9-35c7-4a3e-ad4c-c2915928b7c0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:10.460458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ed1b9-35c7-4a3e-ad4c-c2915928b7c0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:10.471880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:10.473084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.473576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.474116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.485732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:10.501571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:10.503422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 143/294] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:10.509598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:10.528239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0c05e-533a-4543-8cc7-2dc0f91680e0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:10.541111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:10.541882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.542172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.542460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.543227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:10.543540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:10.545143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:10.555129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 152/295] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:10.561849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:10.573690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a0e2-8270-459f-b24c-7ef926ee2ca2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:10.582558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:10.583714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.584233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.584700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.586129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:10.588370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:10.590302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 144/296] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:10 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:10.596680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:10.610847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c5caa-86d5-4ade-a09d-9190736a39f5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:10.622101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:10.622979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.623261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.623553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.629342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:10.631445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df02226-e823-43de-bb23-31a6328ad242 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:10.633469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 153/297] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:10 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:10.640497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:10.655094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b6619-d0a4-431c-acc0-42d028eed6d1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:10.660158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:10.661383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:10.661881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:10.662376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:10.664597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6137b31db374b6ba2f413c885d90346, group_id=d40db8b584544759bc9a8dc856e8fb0f, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:10.668146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7ab06-1784-42de-a7d6-cdae6d81b0aa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:10.697701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 145/298] 10.222.0.77 () {58 vars in 1463 bytes} [Fri Jan 28 01:49:10 2022] PUT /identity/v3/projects/a6137b31db374b6ba2f413c885d90346/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:11.500980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f722a8-9fd1-42a3-804c-76d8ea5a2846 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.501364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f722a8-9fd1-42a3-804c-76d8ea5a2846 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.501539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f722a8-9fd1-42a3-804c-76d8ea5a2846 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.503643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 154/299] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:11.510669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.511238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.511726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.535456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:11.536960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:11.554744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9815-cf4c-4f5a-8097-edf86cda31d9 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.555670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9815-cf4c-4f5a-8097-edf86cda31d9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.556171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d9815-cf4c-4f5a-8097-edf86cda31d9 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.558803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 155/300] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:11.566219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.566775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.567282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.585943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:11.587450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:11.637549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 146/301] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:11.662349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.673162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f3ec-8f4e-4d75-97b2-198ed07e5c4f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.679678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.680815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.681309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.681801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.694657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 156/302] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:11.702690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:11.709659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:11.711355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 147/303] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:11.724018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.734624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd0847-a7f5-48fb-80f1-c8af50ffb288 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.739292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.740191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.740676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.741163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.742167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:11.742680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.744540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.756911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.767043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 157/304] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:11.769690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b12d1-be95-4757-bed6-94c8886a1a02 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.773537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.781293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.782408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.782896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.783443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.794443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51481e-1dcf-4425-acf4-ef8117bff723 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.803591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:11.808664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.809771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.810287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.810762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] PATH_INFO: `/v3/groups/0740e2a3513b4be781ab840276c6b4ca` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.815066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:11.815978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] RBAC: Authorizing `identity:get_group(group_id=0740e2a3513b4be781ab840276c6b4ca)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.818100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.820231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 158/305] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/groups/0740e2a3513b4be781ab840276c6b4ca => generated 229 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:11.821882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 148/306] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:11.825938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.831850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.843388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fa93-8096-4c46-943f-11cb0ad45e10 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.850180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f93ed-a7f8-4003-949a-a6d39c58a250 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.856375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.857862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.859473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.860364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.863311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] RBAC: Authorizing `identity:get_project(project_id=83aa2e6f27d34fe78a1b709f22247aec)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.863666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.865466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.865978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.867036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.867781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.869709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:11.870275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.872976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 159/307] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:11.873601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.878709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.892644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f45018-fd8c-45ce-9d31-f406e8bdcff1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.893823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 149/308] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:11.898703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.900073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.901799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:11.907182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.908473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec/groups/0740e2a3513b4be781ab840276c6b4ca/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.912762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aa2e6f27d34fe78a1b709f22247aec, group_id=0740e2a3513b4be781ab840276c6b4ca, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.917320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937cc9-2f4a-403d-af4a-8266c29f1b99 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:11.918953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.928481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:11.929779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:11.930452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:11.931004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:11.932805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:11.935626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:11.944712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 160/309] 10.222.0.77 () {58 vars in 1463 bytes} [Fri Jan 28 01:49:11 2022] PUT /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec/groups/0740e2a3513b4be781ab840276c6b4ca/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:49:11.945059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 150/310] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:11.951049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.042910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d9d1-2cd9-48ce-bb2d-905e56287835 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.049530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.051041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.051531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.052028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.054851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.057790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fbf32-a883-4fd9-9e17-349f95010274 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.059753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 161/311] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:11 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:12.066358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.078477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac4d30-bb02-48d6-af10-84e592b386ec admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.084256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.085448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.085987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.086483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.090203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6137b31db374b6ba2f413c885d90346, group_id=d40db8b584544759bc9a8dc856e8fb0f, role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.093250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123b192-6ec5-4b0a-9a05-891026b1727e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.121696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 151/312] 10.222.0.77 () {58 vars in 1463 bytes} [Fri Jan 28 01:49:12 2022] PUT /identity/v3/projects/a6137b31db374b6ba2f413c885d90346/groups/d40db8b584544759bc9a8dc856e8fb0f/roles/ff066e890e8f45759e7037b2a84080ab => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:12.148664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7eb11-2b00-4041-9adb-edcd4d52ffc8 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.149404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7eb11-2b00-4041-9adb-edcd4d52ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.149989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7eb11-2b00-4041-9adb-edcd4d52ffc8 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.152523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 162/313] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:12.160175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.160827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.161332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.190575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:12.192154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:12.267740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 152/314] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:12.304598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7eb11-2b00-4041-9adb-edcd4d52ffc8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.323231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7eb11-2b00-4041-9adb-edcd4d52ffc8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.331289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.332469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.333045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.333548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.346954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:12.354971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:12.356551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 163/315] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:12.365804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.375545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf912a7-1954-477c-8679-ef6c6dcd1408 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.387385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.388078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.388360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.388636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.389397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:12.389703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.391363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.402041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 153/316] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:12.408133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.419775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582322-ec87-4b7e-8356-eee8bcabde37 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.426406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.427417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.427989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.428460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.438115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.440206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.455334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 164/317] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:12.461606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.471505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a705-cacc-418c-82a4-1cc2eabb635e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.481433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.482335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.482621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.482900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.486506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.488584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.490311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 154/318] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:12.497005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.507049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09222-58da-4a76-821d-2eee7103fe91 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.516600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.517870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.518357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.518869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.526970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.529452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81380cc-9c19-4f7c-b5b0-c328276aa2cf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.531448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 165/319] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:12.537904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.551233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b41fa-2c91-4606-a22b-ccfd3107478e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.562094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.562688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.562975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.563256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.564093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=c7f118b848914748a8b0a821a6dcbff6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:12.564413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.566292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5cd97-9375-48c6-a025-fe1e87ef608e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.578339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 155/320] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:12.805971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51141-9803-4654-b5a4-05116510a5cd None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.807033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51141-9803-4654-b5a4-05116510a5cd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.807526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51141-9803-4654-b5a4-05116510a5cd None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.809599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 166/321] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:12.817226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.817674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.817765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.846919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:12.848180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:12.856881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 156/322] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:12.883315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51141-9803-4654-b5a4-05116510a5cd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.903766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51141-9803-4654-b5a4-05116510a5cd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.908513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.909600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.910132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.910624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.923646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:12.931728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:12.933148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 167/323] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:12.939471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.953139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f4074-e772-40a5-a1a5-569e0e6ba8a7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.960467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.961397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.961943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.962418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.963952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:12.964463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.966313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.977379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 157/324] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:12.983177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.996582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02455bd-6d9d-4784-a095-e633ef4b1b30 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.001530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.002457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.002969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.003447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.015670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.018542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.033638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 168/325] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:13.039972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.050009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e242d6-d93d-40bb-b5f9-f8c35f83c46c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.060089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.061268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.061787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.062290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.063694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.065971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.068163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 158/326] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.074786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.084525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f947f6-e7e7-4a5a-8106-2543c2ef8375 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.091753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.092928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.093410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.093929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.097691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.099999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f24f9e-dc90-4d88-b331-2b1aae5c7c51 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.101899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 169/327] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.108617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.118782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e48a-2959-49ef-91c3-d2179fd28844 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.127766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.128720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.129207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.129682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.130877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=c7f118b848914748a8b0a821a6dcbff6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:13.131414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.133626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607ca-6f9b-408f-8a53-98893a6e5e41 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.141171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 159/328] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=c7f118b848914748a8b0a821a6dcbff6&role.id=ff066e890e8f45759e7037b2a84080ab => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.720686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad1f9-98ba-4516-9af2-8d0a6e117d6f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.721091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad1f9-98ba-4516-9af2-8d0a6e117d6f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.721274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efad1f9-98ba-4516-9af2-8d0a6e117d6f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.723179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 170/329] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:13.730253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.730549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.730828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.748591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:13.749806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:13.757257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 160/330] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:13.782108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efad1f9-98ba-4516-9af2-8d0a6e117d6f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.793938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efad1f9-98ba-4516-9af2-8d0a6e117d6f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.798121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.798903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.799184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.799458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.810013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:13.816768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:49:13.818243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 171/331] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:13.824776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.834225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf7ea3-30d3-429b-9733-6f3db12da5cd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.839166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.839821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.840099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.840376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.841112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:13.841417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.843039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.851560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 161/332] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.857208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.866802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6133-320b-4e47-bd9a-debd6e3d6e62 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.871220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.871854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.872139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.872416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.880860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.882659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.892407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 172/333] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:13.898656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.908772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f058b9-c9d9-4bc7-a3b5-438ef88a4258 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.913377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.914253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.914531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.914801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.915963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.918037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.919826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 162/334] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.925548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.934822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32609ef2-5c07-4a02-82d0-3c2f58fb5da3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.939087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.939932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.940214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.940494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.941635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.943553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84054-c836-4c17-837a-cffff80ff558 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.945264 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 173/335] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:13.951835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:13.967964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818c7f8-f563-4ef6-8a6b-7ea74eed7974 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:13.972912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:13.973511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:13.973820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:13.974216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:13.975047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=7b50e9525378402f8072ab2eb6a2a40f, scope.project.id=a6137b31db374b6ba2f413c885d90346) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:13.975362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:13.977191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced05f2-25df-4189-b76b-8d9221a57ad7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:13.985782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 163/336] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:13 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=7b50e9525378402f8072ab2eb6a2a40f => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.500682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab124d9c-e187-4809-9845-4b38ae1c9677 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.500974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab124d9c-e187-4809-9845-4b38ae1c9677 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.501254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab124d9c-e187-4809-9845-4b38ae1c9677 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.503066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 174/337] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:14.510765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.511055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.511333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.516785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493011-d967-4df0-8a96-1d6f3cb6465b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.517076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493011-d967-4df0-8a96-1d6f3cb6465b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.517363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493011-d967-4df0-8a96-1d6f3cb6465b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.519096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 175/338] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:14.526850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.527068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.527339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.529423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:14.530639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:14.538094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 164/339] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:14.544158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:14.545316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:14.552802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 176/340] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:14.561880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.570497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140f90f-29de-4a18-835c-6a1fa9e62971 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.575276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.576039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.576320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.576565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.576656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.584921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1278-affe-40c6-b165-8ed421aaf691 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.586985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:14.589803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.590587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.590866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.591138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.594236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:14.595499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 165/341] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:14.600853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:14.601570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.608015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:14.609137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 177/342] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:14.610797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952499da-75a5-4b29-a973-62381afd4346 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.614939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.615382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.616001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.616288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.616568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.617307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:14.617617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.619232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.623921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331546-7482-47f7-85c9-ed71b727071f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.627791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 166/343] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.628199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.628822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.629103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.629379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.630141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:14.630453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.632022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.633677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.640998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 178/344] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.643964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee53c5c-5e50-4c39-8ca8-bc30d15c74cb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.646462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.648479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.649089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.649372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.649648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.655746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6176a-a540-481b-9f1d-f5c2886485d4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.657786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.659507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.659915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.660509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.660792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.661065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.667994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 167/345] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:14.668419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.670115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.673949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.679200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 179/346] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:14.682287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a729d-b490-46ef-a531-3c8c1208d9db admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.684696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.686632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.687433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.687712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.687981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.689134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] RBAC: Authorizing `identity:get_project(project_id=83aa2e6f27d34fe78a1b709f22247aec)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.690889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.692594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 168/347] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.692696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c5ce2-2d2b-40fc-a0b6-586fdbc5c93f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.696832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.698161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.698440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.698712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.698801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.699872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.701872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.703585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 180/348] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.708135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048925-b09e-4a4d-84e7-53937d22d7db admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.708894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.712195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.712965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.713868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.714145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] PATH_INFO: `/v3/groups/0740e2a3513b4be781ab840276c6b4ca` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.715278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] RBAC: Authorizing `identity:get_group(group_id=0740e2a3513b4be781ab840276c6b4ca)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.717108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.718255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0cd95-f855-4472-9558-a4f206a73187 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.718758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 169/349] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/groups/0740e2a3513b4be781ab840276c6b4ca => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.722468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.723244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.723528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.723803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] PATH_INFO: `/v3/groups/d40db8b584544759bc9a8dc856e8fb0f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.724589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.724916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] RBAC: Authorizing `identity:get_group(group_id=d40db8b584544759bc9a8dc856e8fb0f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.726762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.729782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 181/350] 10.222.0.77 () {56 vars in 1201 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/groups/d40db8b584544759bc9a8dc856e8fb0f => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.733880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e9906-2782-4d34-8b3e-389085299a81 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.734014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:14.738138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.738725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.739009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.739286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.740086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] RBAC: Adding query filter params (group.id=0740e2a3513b4be781ab840276c6b4ca, role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=83aa2e6f27d34fe78a1b709f22247aec) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:14.740397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.742219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03ed3-ca58-49e8-86f2-5bfa5a5b5e1a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.742729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e9f75-11ca-4d60-92d0-70fe8b6aa03a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:14.746856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:14.747443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:14.747723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:14.747814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 170/351] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/role_assignments?group.id=0740e2a3513b4be781ab840276c6b4ca&scope.project.id=83aa2e6f27d34fe78a1b709f22247aec&role.id=570ba9cb94054cda821730576cfb0f2e => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:14.747993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:14.748787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] RBAC: Adding query filter params (group.id=d40db8b584544759bc9a8dc856e8fb0f, role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=a6137b31db374b6ba2f413c885d90346) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:14.749093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:14.750895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc9ae0-e540-4bc9-9cd7-d4427773e370 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:14.757032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 182/352] 10.222.0.77 () {56 vars in 1397 bytes} [Fri Jan 28 01:49:14 2022] GET /identity/v3/role_assignments?group.id=d40db8b584544759bc9a8dc856e8fb0f&scope.project.id=a6137b31db374b6ba2f413c885d90346&role.id=ff066e890e8f45759e7037b2a84080ab => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:17.804311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88509505-2e90-4ffa-8072-73bae75365dd None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.804813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88509505-2e90-4ffa-8072-73bae75365dd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.804813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88509505-2e90-4ffa-8072-73bae75365dd None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.807421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 171/353] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:17.810563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034284-46f0-4639-af17-b1a9fa2f7b69 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.810997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034284-46f0-4639-af17-b1a9fa2f7b69 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.811167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f034284-46f0-4639-af17-b1a9fa2f7b69 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.813440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 183/354] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:17.814054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.814343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.814621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.820857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.821796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.822094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.837126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:17.839237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:17.853435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 172/355] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:17.855389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:17.856646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:17.866594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 184/356] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:17.883934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:17.894318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82508c78-ad62-4ca9-be96-094cc250f866 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:17.897448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:17.903180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:17.903994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.904271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.904545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.908927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f58b9-4bf0-46ed-8396-4e3ffc19370f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:17.920013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:17.920842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.921125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.921400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.923974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:17.926321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:17.936903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:17.939105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:17.950198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:17.951701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 173/357] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:17.958182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:17.964358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:17.966097 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 185/358] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:17.976318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252762e-55b4-4147-b327-528e1546c61f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:17.977670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:17.986892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:17.987819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:17.988302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:17.988777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:17.989735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:17.990283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:17.992081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172adf-b9ca-47e6-af8f-4222cb7e6233 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:17.997962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fdf4-1f9e-4870-afa9-ded8aab7fa89 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.005413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 174/359] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:18.010529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.010529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.010529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.010529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.010860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:18.010860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.010860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:18.010860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:18.010860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:18.012627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80191b-26be-42cc-88e9-3ae2294677ff None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.013043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80191b-26be-42cc-88e9-3ae2294677ff None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.013457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80191b-26be-42cc-88e9-3ae2294677ff None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.014690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab822e98-ce8a-42e1-96d6-b3651a6f6b0c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.015739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 175/360] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:18.022075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80191b-26be-42cc-88e9-3ae2294677ff None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.033952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80191b-26be-42cc-88e9-3ae2294677ff None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.035395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 186/361] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:18.036885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.037317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.037759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.038652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.039309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.039675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.041728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.041728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.042870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.060641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:18.062237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:18.067158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 176/362] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/users => generated 248 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:18.070615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.084569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 187/363] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:18.090564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01f5c9-10dd-48e5-924d-dab3657743a8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.095647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.096660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.097181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.097713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.098709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.100956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.127072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.141784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f16f8-2b9e-44fe-b57f-6eea8c54391a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.149785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 177/364] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/users => generated 248 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:18.152373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.153518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.154042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.154565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.167770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.169983 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.189588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:18.191984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 188/365] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:18.200222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.210980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61ee5-6668-4c16-9b70-c0682d2edc00 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.216205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.217213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.217651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.218109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.219008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:18.219501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.221288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637cb98-412c-49d5-8e57-70ac950b7150 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.235567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 178/366] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:18.242115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.253334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b48780-dadd-48ce-83ff-c8a04f325bd3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.269155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.270137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.270570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.270994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.271888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.273092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:18.273092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:18.273092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:18.274724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6726b8-1658-4dd4-ad95-fce1643dd821 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.308832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 189/367] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/users => generated 246 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:18.528212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46c3f-261a-447b-b97b-ce55828131da None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.528503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46c3f-261a-447b-b97b-ce55828131da None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.528790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46c3f-261a-447b-b97b-ce55828131da None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.530680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 179/368] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:18.538279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.538572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.538858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.559163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:18.560384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:18.572420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 190/369] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:18.602122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46c3f-261a-447b-b97b-ce55828131da None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.619432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46c3f-261a-447b-b97b-ce55828131da None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.623983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.624789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.625072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.625348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.637576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.639442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.670267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:18.671820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 180/370] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:18.678675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.687867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213b90-26c6-4f3e-a6b0-ea8b75fe77d9 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.698059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.698743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.699029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.699311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.700041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:18.700355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.702006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17f6f9-d19e-47ab-a8a3-12b4181b9d26 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.714688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 191/371] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:18.720920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:18.731309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d81a-a2f6-4387-a2c9-d9a546f1d620 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:18.740249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:18.740917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:18.741205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:18.741485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:18.742229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:18.744145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f545fc-efb1-4d2f-89af-56a2ed4b3fc6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:18.774925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 181/372] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:18 2022] POST /identity/v3/users => generated 249 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:19.324259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9787-6a46-472b-8f6f-3e8a5455c726 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:19.324787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9787-6a46-472b-8f6f-3e8a5455c726 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:19.324787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9787-6a46-472b-8f6f-3e8a5455c726 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:19.326917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 192/373] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:19.334569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:19.335485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:19.335991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:19.357301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:19.358858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:19.368767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 182/374] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:19.394177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b9787-6a46-472b-8f6f-3e8a5455c726 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:19.409549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b9787-6a46-472b-8f6f-3e8a5455c726 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:19.413911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:19.414590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:19.414876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:19.415157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:19.415905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:19.417559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:19.427326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.sql.core [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 28 01:49:19.427326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 28 01:49:19.427326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [parameters: {'id': '599c16086da3496c85c5044e04c8857c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 28 01:49:19.427326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:49:19.443290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 28 01:49:19.445020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 193/375] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:49:19 2022] POST /identity/v3/roles => generated 144 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:19.453258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:19.465692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27804ef-3aa3-4c9b-9d70-d5ada2ba1790 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:19.470709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:19.471922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:19.472401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:19.472864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:19.489995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:19.498103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-5bb6a7e9-7ef4-4f72-9b21-79bb14a397af admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:49:19.499553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 183/376] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:19.505991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:19.522180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b4ba8-27a8-4a24-86fd-f09b0c6f2e52 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:19.530328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:19.531037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:19.531325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:19.531610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:19.532392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:19.532717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:19.538587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465bf7-ccbe-4e51-860a-8e728522cae9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:19.547766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 194/377] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:20.614985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb250a5-9e59-417a-8df7-93643989279a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.615465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb250a5-9e59-417a-8df7-93643989279a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.615465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb250a5-9e59-417a-8df7-93643989279a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.617480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 184/378] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:20.629895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.630353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.630536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.658024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:20.659233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:20.672054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 195/379] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:20.708583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb250a5-9e59-417a-8df7-93643989279a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:20.724293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb250a5-9e59-417a-8df7-93643989279a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:20.729521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:20.730410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.730694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.730973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.743634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:20.751389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:20.752938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 185/380] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:20.759382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:20.768462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedf7f-1fa8-4fec-bb3d-25497d5995bf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:20.773013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:20.773740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.774069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.774353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.775139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:20.776013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:20.777772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee38550-daa8-463d-a2c4-f6bf8249b8da admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:20.786009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 196/381] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:20.792624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:20.805182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bdbca7-b343-47ca-ae5b-e1f7dfce6fe7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:20.809853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:20.810657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.810945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.811227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.828452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:20.830416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:20.840688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4517a-9874-40d8-bdb5-3dffa64b9c5f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.840966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4517a-9874-40d8-bdb5-3dffa64b9c5f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.841248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4517a-9874-40d8-bdb5-3dffa64b9c5f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.843052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 197/382] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:20.852904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030638-0955-446f-91ba-2ca9df13f0d9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.853441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030638-0955-446f-91ba-2ca9df13f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.854534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030638-0955-446f-91ba-2ca9df13f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.855464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:20.857309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 186/383] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:20.863604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:20.874557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80c3ee-e559-4912-93bf-bdcb7e48cabb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:20.879568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:20.880143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.880427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.880711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.881470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:20.881799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:20.883660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:20.919875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 187/384] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:20.941399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:20.954754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b7829-5efd-499c-8d7c-6a913e14e29f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:20.961934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:20.963749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:20.964038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:20.964322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:20.980264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:20.982388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:20.997672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-eb045ad3-5f46-4b9a-93b7-69a663ecae0d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:49:20.999053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 188/385] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:21.000352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3047bb-267c-4970-99a9-3627cb4567a4 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.000640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3047bb-267c-4970-99a9-3627cb4567a4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.000920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3047bb-267c-4970-99a9-3627cb4567a4 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.008065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 189/386] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:21.008917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3047bb-267c-4970-99a9-3627cb4567a4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.021781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3047bb-267c-4970-99a9-3627cb4567a4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.027033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.027766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.028103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.028385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.029282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.029608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.030712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:21.030712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:21.030712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:21.031994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.046072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-63030638-0955-446f-91ba-2ca9df13f0d9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:21.047278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-63030638-0955-446f-91ba-2ca9df13f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:21.061836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 198/387] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:21.063201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.063490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.063769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.071846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 190/388] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.080299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.093844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e451-b4b4-46d6-bdb3-e6f87fd34dce admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.098158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:21.098529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.099233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.099420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:21.099580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.099847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.107783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 199/389] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:21.108334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.110023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.111899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.117348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237d5f3-2dfe-4c4d-8a55-e470badaaf38 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.122422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 191/390] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:21.128734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.131437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.132260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.132548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.132824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.139181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ea17-5631-48bb-8f2b-12bf82829969 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.144152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.144948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.145362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.145665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.151679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:21.157129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.158713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:21.159035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.159922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 200/391] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.160811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.171453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02527-4591-4b5c-9742-5cf1351b08a9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.176200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.176992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.177278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.177558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.180797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:21.183711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 192/392] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:21.186121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.200675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:21.201817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b0699-4987-43bb-a23a-7891aef6290d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.208507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:21.209960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 201/393] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.210527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.218618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.219454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.219798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.220080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.220825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.221189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.222187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619a70-a66c-4625-b417-439a164960e1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.222944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.227174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.227829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.228115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.229796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.230427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.230747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.232592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 193/394] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.233263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.233511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.243235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4de32-85d1-4e00-8d28-24e01f00c7ab admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.253663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.253924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 202/395] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.253924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.254242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.262429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 194/396] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.263274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.269233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b79bc-5804-4b10-82c9-ac10a3b1bac1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.275614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.276447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.276729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.277002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.279589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f604102-b58a-4de9-b287-5a610cf103c7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.283571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.284525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.284930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.285327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.289039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.291517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.294139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.296217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.310558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:21.311944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 195/397] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.312047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:21.312991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.313246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 203/398] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.319503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.328167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0558-3709-4b57-8758-39abfd48cf73 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.330473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89794905-cb88-4e34-9b94-d169db79e384 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.333297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.334412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.334917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.335376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.335501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.336402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.336772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.337130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.338572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.338964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.340037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:21.340037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:21.340037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:21.341428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.349161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.351287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.359854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 204/399] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:21.366186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.370486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:21.372076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 196/400] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.373639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.376478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b34e7-acde-4eed-875c-5992ab759727 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.381504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.382244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.382641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.382930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.383655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.383971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.386005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3b98-4f89-44b2-93b5-2820f7760d4d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.386159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.391407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.392253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.392672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.393605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.394655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=4799e6d178524148b5aea9a28ddc5145) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.395191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.398090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.398805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 205/401] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.399597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.405225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 197/402] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/role_assignments?user.id=4799e6d178524148b5aea9a28ddc5145&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.406483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.417322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8930-708a-45d1-b67e-da5855e33d40 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.417531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4655dd-2046-4dca-910b-ccfb6203e66f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.427554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.429962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.430384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.430858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.431829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.432339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.433588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.434079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.436686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.437219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.441245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.454896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.457369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.466837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 206/403] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.476152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.491418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4b84-298f-46d5-9006-d1be14d9f4fa admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.492163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:21.493732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 198/404] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.500065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.507271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.508124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.508413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.508709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.512801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb8c1e-a368-4d8a-8d6b-5c28aac51077 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.519331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.520514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.521019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.521532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.522756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.523289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.526377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.531121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.535059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.550567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:49:21.552406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 207/405] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.559380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.565103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 199/406] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.571014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.581166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867113b6-7947-419e-beda-ae50dab3b703 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.587221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829db23-90c8-45c2-9f80-f514144cdeaf admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.589255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.589255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.589474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.589659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.590452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.590767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.591882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:21.591882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:21.591882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:21.593272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.594907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.596061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.596593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.597064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.606666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.609914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.622503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 200/407] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:21.628186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.636765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 208/408] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.639595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8c5f-d5b5-4288-b0c3-108535397159 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.642725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.646596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.647627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.648103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.648813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.657312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792d2ba-1898-4f37-8091-129662b2fc3e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.668685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.670927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.674381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.675052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.675344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.675628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.690304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:21.692568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 201/409] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:21.693176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.697231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.698868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.708658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 209/410] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:21.713674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f59b7-c03c-4899-bfdf-73d55bec8d9d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.715827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.726339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.727315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.727814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.728283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.730685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06f39a-886a-4e94-a183-b624443aca9b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.731631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.732135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.733974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.745323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.746411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.746892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.747360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.759069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 202/411] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.763555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.765694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.771521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.778423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c23a6-8a6d-4689-8969-59ce657f8eae admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.783094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.784520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.785004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.785489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.794407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.796916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.802706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:21.803914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 210/412] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.810624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.812375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:21.813847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 203/413] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:21.819899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.827425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03cd84-9ed0-4df7-aac0-a92f8b1f7041 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.831976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5e2f-2505-4d0d-8659-97a6e4549699 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.836244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.836916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.837199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.837481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.838159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.838290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.838574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.839344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.839811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.840184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.840536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.841504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.842220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.843501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:21.843501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:21.843501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:21.844941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.865364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 211/414] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.877397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 204/415] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:21.878996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.886694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.895810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c4c4b-fa0f-41c1-94b0-5de0815a0c85 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.902943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016e40-dd9e-44f6-becb-d4cb0fe7477d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.906074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.906876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.907160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.907444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.916850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.918849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.920286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.920945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.921228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.921506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.922361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.922676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.924527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.936758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 205/416] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.944855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:21.946578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 212/417] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:21.953782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:21.964692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84308e-4842-4e8c-96d9-76612bab3e4e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:21.974234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:21.974917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.975204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.975480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.976273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:21.976587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:21.978528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28979b65-705f-4ab4-8adf-821c0cf0e832 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:21.991829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 206/418] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:21.999236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.015925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aa10e-5fa7-42de-ae53-e61fc7ee28fe admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.032019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.032706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.033049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.033381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.034265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=f0df50dd209d43f2b2b51267672145f2) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.034584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.036601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8971c5-0217-4b3c-8672-c5ab23fe876f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.048925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 213/419] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:21 2022] GET /identity/v3/role_assignments?user.id=f0df50dd209d43f2b2b51267672145f2&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.077251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ff48-a3fb-44d0-b328-cb0a2dcbb4a2 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.077565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ff48-a3fb-44d0-b328-cb0a2dcbb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.077859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089ff48-a3fb-44d0-b328-cb0a2dcbb4a2 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.080256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 207/420] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:22.088965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.089285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.089515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.108997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:22.110293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:22.118606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 214/421] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:22.143563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ff48-a3fb-44d0-b328-cb0a2dcbb4a2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.156975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089ff48-a3fb-44d0-b328-cb0a2dcbb4a2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.161466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.162450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.162676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.162959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.175825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:22.183328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:22.184889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 208/422] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.191259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.201340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0452-5a4a-496c-971b-cddd8d6159bd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.206349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.207044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.207330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.207612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.208377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.208691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.210451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.225548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 215/423] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.231820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.243833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24967e-624c-4547-8b28-51462ac5dd46 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.258398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.259272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.259559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.260434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.275145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.277608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.302391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:22.303785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 209/424] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.311009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.327775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144400fb-a9a8-4f5a-872b-d0529256fa0c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.336275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.336958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.337247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.337531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.338344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.338658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.340265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.356927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 216/425] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.362978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.373433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b122213-d3aa-4fba-8cba-1ea25199d5cd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.378567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.379418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.379783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.380303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.389240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.391570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.418335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:49:22.419812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 210/426] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.426103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.442901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff1d4b-1918-4f55-bb43-98fcd53f840b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.452964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.453699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.454016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.454349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.455242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.455557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.457464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.488554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 217/427] 10.222.0.77 () {56 vars in 1160 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.494795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.510656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28859d79-2c2b-4d1f-aa7b-7b91f1a8e0e9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.522360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.523016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.523302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.523582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.537630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.539425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.553059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 211/428] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:22.559166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.575367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17298581-9388-4c25-ad76-65e6f6f3a2fe admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.584878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.585771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.586083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.586366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.606644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.608701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.633487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-fa432a58-5f10-4550-8549-4aa8cf202fb1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:22.634741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 218/429] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.640844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.655149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5e8e-6768-4a5a-9a1a-6cbb4360b2f5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.669531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5fec-b4b8-490f-8a53-10a2cccce324 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.670438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5fec-b4b8-490f-8a53-10a2cccce324 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.670995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5fec-b4b8-490f-8a53-10a2cccce324 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.671304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.671972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.672261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.672543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.673267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.673580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.674232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 219/430] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:22.676892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.688085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 212/431] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.694223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.694518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.694801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.700624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.719777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0ca0-2053-408e-b24f-faf9e0f81b01 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.722395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:22.723564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:22.731042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.731827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.732115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.732393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.741253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 220/432] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:22.746964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.748924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.771481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:22.772957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 213/433] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.779724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.790969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.792246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9392-a42f-4d56-84d0-6461ba0d134f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.796868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.797918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.798259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.798541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.799336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.799650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.801886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.814425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 221/434] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:22.815977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05169a91-bf47-4400-a25b-7e572272c27d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.820640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.824193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.824985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.825270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.825546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.830873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d54b4-7582-43ba-b2bd-98432ccfb71b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.835531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.836182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.836531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.836818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.837802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=c507723bf8bc4a6aaf7adba0ef25f962) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.838723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.840712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.846859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 222/435] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/role_assignments?user.id=c507723bf8bc4a6aaf7adba0ef25f962&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:22.846982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.848729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.884739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:22.886040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 214/436] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:22.892730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.908188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fd2ab-18fe-41e8-824c-4ec1aac185f8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.916926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.917840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.918073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.918355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.919086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:22.919443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.921179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa7cb-5510-4a73-9445-131acf9fc3c9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:22.943553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 223/437] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:22.949830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:22.967206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99714fa3-4323-493b-9423-7a89580d301e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:22.978324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:22.979582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:22.979867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:22.980149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:22.980882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:22.982883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c8a10-330a-4eb2-bd99-d4104f8e641c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:23.023897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 215/438] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:22 2022] POST /identity/v3/users => generated 247 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:24.192121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c3d3-c32c-4e11-8fd8-875d0a239e97 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.192636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c3d3-c32c-4e11-8fd8-875d0a239e97 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.192739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608c3d3-c32c-4e11-8fd8-875d0a239e97 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.194759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 224/439] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:24.211754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.212239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.212311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.238745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:24.240014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:24.248996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 216/440] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:24.285294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c3d3-c32c-4e11-8fd8-875d0a239e97 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.304265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608c3d3-c32c-4e11-8fd8-875d0a239e97 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.312142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.313248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.313583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.313901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.327471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:24.334298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:24.335481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 225/441] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.341905 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.350929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95608683-6733-4343-b3e9-83ce60693cc3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.361433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.362133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.362415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.362690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.363448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.363755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.365347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.377163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 217/442] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.383093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.398759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38107ac7-d153-48c3-a2e1-586b3d191e87 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.403468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.404260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.404545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.404825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.416753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.418713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.446780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:24.448030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 226/443] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.454652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.471103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc790b-6e4d-4dd1-a184-2ec5e1c32017 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.478898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.479584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.479873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.480156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.480880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.481192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.482811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293881b-0fc0-4eeb-9912-138fe6304c58 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.500312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 218/444] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.506120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.518676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f9c83-85b5-4e57-a83e-75edceda4f18 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.528963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f901fbd-f9f2-4e2c-b0fc-c404566c6f0b None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.529246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f901fbd-f9f2-4e2c-b0fc-c404566c6f0b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.529522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f901fbd-f9f2-4e2c-b0fc-c404566c6f0b None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.531552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 219/445] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:24.531727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.532509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.532792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.533122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.540471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.540754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.541609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.552238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.554317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.572386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:24.573621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:24.583180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:49:24.586273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 227/446] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.591700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.593711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 220/447] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:24.603200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a672c-cb81-40ba-9e37-a37c530877c9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.608287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.609013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.609296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.609622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.610542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.610854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.612864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.631239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 228/448] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.637036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.642275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.646449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72b8be-0936-4b31-b00b-ba0c02a711c0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.651717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.652507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.652809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.653074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.655338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8617621-2517-490d-8901-18e3160ca32e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.663929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:24.671323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.671747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:24.672125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.672413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.672691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.673397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 221/449] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.680264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.694610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.696378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0966f73-ad41-4fa2-9457-de5fe9c16200 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.698348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.705291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.706043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.706331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.706662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.707464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.707777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.709377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec913a4-28ca-4e2d-a35b-422916efe83a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.719536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 222/450] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:24.720339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:24.720868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a8ba-af49-4267-bc27-1acf18265fbb None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.721159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a8ba-af49-4267-bc27-1acf18265fbb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.721440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a8ba-af49-4267-bc27-1acf18265fbb None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.722611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 229/451] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:24.723272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 223/452] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:24.729845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.729973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a8ba-af49-4267-bc27-1acf18265fbb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.741022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971c38a-cd36-42da-8d6a-6887cad3b021 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.742297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a8ba-af49-4267-bc27-1acf18265fbb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.746041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.747090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.747316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.747809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.747979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.748298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.748586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.748841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.749412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.749853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.751694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dde37e-6885-45d4-b7ac-9f9f081a636f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.760031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.762169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.764055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 224/453] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:24.770271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.770571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.770861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.782391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:24.784171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 230/454] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.785141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.789821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:24.791707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:24.796668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbde3-767f-4415-aca7-a6e5e0ff4bd7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.801578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 225/455] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:24.801954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.802464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.803194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.803674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.804145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.818021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.820421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.822723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfc0b-994a-4ac7-88a4-ce25885f66ec None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.832308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.832980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.833319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.833605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.834483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.834796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.836457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.840262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:24.841956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 231/456] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.842938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.855494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 226/457] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.856188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.859292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e8f81-970c-49dd-a17f-d7c88f1b4b39 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.864437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.865440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.865966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.866462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.866999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dca4f-9525-4d22-bb10-1a069ddc012e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.872565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.873442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.873732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.874153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.875990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.876579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.878905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:24.879429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.886383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:24.888247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 232/458] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.889331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.900246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 227/459] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.905861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.909936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef068718-580a-48b2-8ef2-cb6a493514fe admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.912625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2129b-1a3a-45b6-a1fc-737eb101241b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.915101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.916758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.917242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.917899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.918215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.918933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.919306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.919701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.920456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:24.920852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.923362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.928291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.930589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.933459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 228/460] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:24.939129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.945495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:24.946931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 233/461] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:24.948513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:24.950117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3fd18-088d-4a27-ac0e-8a7d4fc8be5c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.954864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.955832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.956086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.956370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/4799e6d178524148b5aea9a28ddc5145/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.959750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0585ac-76fb-4527-b708-e2d02ab36fb7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:24.965080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:24.966158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:24.966682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:24.967155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:24.974025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=4799e6d178524148b5aea9a28ddc5145, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.977048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.979139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:24.981167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:24.992307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 229/462] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:24 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/4799e6d178524148b5aea9a28ddc5145/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:24.993615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.000292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:25.002257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 234/463] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:25.010205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.036070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ff84-4cca-4dfb-90d5-aa2183e4dd47 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.076203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a25490-ca22-4851-85b0-a6af517fe881 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.081863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.082946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.083513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.084024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.085068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.085628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.088565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.112131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 230/464] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.120122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.136142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab57d9c-17f2-4ad7-875d-54818b9e17eb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.148806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.149621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.150253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.150976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.151450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.151730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.152401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.152748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.153686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.156494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.158867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.179971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.184391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 235/465] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.184538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.191062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.208623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a3e8c-e95d-4fc8-8c7e-806b253fd3f7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.218205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:25.223934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.225061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.225552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.226094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.227968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 231/466] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:25.235600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.242647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.245458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.248397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcedbc-c8d7-4b7a-af6c-2a3d1d359cb8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.261232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.262252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.262739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.263233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.264175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.264278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:49:25.264770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.265463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 236/467] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:25.266809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.271792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.282773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 232/468] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:25.283001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab167d-1e41-44f1-934a-ef3f3896c0eb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.287712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.288444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.288715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.289000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.289357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.289870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.290192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.292063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.301601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc70a32-64b4-474e-9f2f-ac0ec83edc52 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.308422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.310192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.310721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.311219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.314172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 237/469] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.319750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.320201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.323026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.332138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe272-2380-49c1-872c-fdde9e94501d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.338668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.339522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.339807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.340087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.340292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:25.342382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 233/470] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:25.351955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.356859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.361373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.373257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e48e3-6eae-4652-ad14-40af291cf08f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.382314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.383024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.383309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.383588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.384431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.385302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.389779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.395583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:25.403789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 238/471] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:25.409476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.419034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 234/472] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.421417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8d87-0e57-4d47-8da6-9389ffa7f414 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.423974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.433783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.434594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.434884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.435160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.437157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.437466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.440079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5ff2a-5f3a-4c87-8c22-111b975117a9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.441334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.452638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.453587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.453898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.454269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.465677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 239/473] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.474505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.489526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1cda2-ae73-4d9b-a92f-70c2e9ccfbf3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.491146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=77efb1f35bc948b1b218f0ae9deca0f9, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.493889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.502048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.502931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.503247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.503551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.516740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 235/474] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:25 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:49:25.527348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.529551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.548031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:25.549290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 240/475] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:25.556051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.647220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750ad5-d6d8-48f4-b378-f413afe41e5b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.654986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.655669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.655956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.656234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.657032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.657347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.659276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499af99-7118-47da-9825-0ebe2fc1d1ee admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.675423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 236/476] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.682771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.692897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7cfc1-8b60-4921-8612-05b6ce5d1572 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.698106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.699054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.699338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.699616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/f0df50dd209d43f2b2b51267672145f2/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.717267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=f0df50dd209d43f2b2b51267672145f2, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.719987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428520b4-db55-4ea1-9d12-4ef5709a26c2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.735657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23ac0-51a6-456f-8797-9ae1a697a84e None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.736015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23ac0-51a6-456f-8797-9ae1a697a84e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.736279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee23ac0-51a6-456f-8797-9ae1a697a84e None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.737820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 241/477] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:25 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/f0df50dd209d43f2b2b51267672145f2/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:25.738316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 237/478] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:25.746604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.746908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.747158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.772778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:25.774043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:25.842197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 242/479] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:25.877879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23ac0-51a6-456f-8797-9ae1a697a84e None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.895684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee23ac0-51a6-456f-8797-9ae1a697a84e None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.901894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.902793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.903080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.903422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.923328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:25.930852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:25.932454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 238/480] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:25.938739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.948546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385d313-3a6e-46e2-9af6-533db00bec4e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.953234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.953980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.954277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.954555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.955314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:25.955628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:25.957359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541ea6e-270a-4cc4-932d-b7ffb2f08c2a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:25.969040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 243/481] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:25.974997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:25.986107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393904d-3aca-4c01-b06e-1b07c78de81a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:25.989032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3d72-a51e-4c35-a7fe-e2ae7b8c5c5b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.989327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3d72-a51e-4c35-a7fe-e2ae7b8c5c5b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.989609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3d72-a51e-4c35-a7fe-e2ae7b8c5c5b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:25.991711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 244/482] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:25.992070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:25.992891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:25.993181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:25.993465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.005544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1555-d141-482e-a392-51457b76da1c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.006115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1555-d141-482e-a392-51457b76da1c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.006944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1555-d141-482e-a392-51457b76da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.008986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.011527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.029259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:26.030402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-838c1555-d141-482e-a392-51457b76da1c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:26.031110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 239/483] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:26.032094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-838c1555-d141-482e-a392-51457b76da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:26.036868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.040226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 245/484] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:26.051256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70b6e7-0cbc-495a-ae08-33cd7726a023 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.057963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.058849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.059337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.059840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.060774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.061284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.063118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.066361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c1555-d141-482e-a392-51457b76da1c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.076675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 240/485] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.077190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c1555-d141-482e-a392-51457b76da1c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.082024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.083060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.083563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.084067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.086922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.097888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0e7d-8cf0-4455-a027-91a399a6f344 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.109777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.110903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.111394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.111871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.113665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:26.123820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:26.125208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 246/486] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:26.127750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.129953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.131628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.143339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db30f2-fd07-4944-b62c-7b840a66b931 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.147594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.148058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:49:26.148255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.148585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.148861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.149666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.150112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.150509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 241/487] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:26.155388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.156400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.170773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 247/488] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:26.170773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.171038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89dd7-d806-463f-a389-d55935d51f4c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.185633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.186472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.186761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.187041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.189024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.190015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.193622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.194283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76e81-93ea-4952-b149-3a31cde56a40 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.205132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.205999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.206279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.206554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.226783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.231391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.231956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 242/489] 10.222.0.77 () {56 vars in 1160 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.239410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.256389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:26.261958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 248/490] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:26.264662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.267647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d55c-5fcf-45ce-a7c4-b13afc0b236a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.275089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a161f40-8f89-42c3-911c-efacfb907ae4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.279720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.280422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.280763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.281090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.281852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.282165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.283856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.296103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 249/491] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.301873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.302335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.302717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.303069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.303356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.313325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0dc7-bf55-4a38-aa51-4e6dbc1af8da admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.318360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.319151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.319430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.319760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.328973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.331081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.344757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:26.346299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 250/492] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:26.346664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.348586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.352500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.362101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9f85-c13a-48f1-a176-7a1213ba28d4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.370391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.371042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.371325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.372455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.374330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.375625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.378959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:26.380326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.382868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 243/493] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:26.389556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.409135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d70ce5-8ce8-4478-98ab-5d19d41fbd08 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.415616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 251/494] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:26.423392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.424363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.425126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.425412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.425688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.426824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.427135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.431806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.438577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d69345-f629-4e65-893a-bdeb7550dac8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.443047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.443744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.444029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.444363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.445786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 244/495] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:26.451870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.453571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.455421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.469769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 252/496] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:26.470303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9fa5b-4628-4358-920f-ef1a7b42d10d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.471704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.475399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.476416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.476982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.477461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.481608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f48c3-0644-48c7-a2cc-7a15e3ebcb54 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.489668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.491663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.495069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.495860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.496142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.496452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.519163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.521022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.525357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:26.526848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 245/497] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:26.532910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.555477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a86af-9bef-4f03-888d-9a9fceed95cd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.556531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:26.558661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 253/498] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:26.562069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.562975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.563478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.563983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.564665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.565310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.565839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.567870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.574959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4fb4-8048-4727-8903-e684438a8781 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.580042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.580826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.581182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.581585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.582222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 246/499] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.587628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.587628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.587628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.588872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.597549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 254/500] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.604220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.604777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a53c-6668-4845-9ccb-36be5a12bba0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.614574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe137-d747-4d3b-9c7c-de7a79d4e70d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.618907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.619817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.620386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.620599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.620700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.620939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/c507723bf8bc4a6aaf7adba0ef25f962/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.621038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.621216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.628768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.630978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.645016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:26.646284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 255/501] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:26.652568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.659687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=c507723bf8bc4a6aaf7adba0ef25f962, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.662290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1eb98-c016-4552-a1fb-7fbfff3b2a3b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.662427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454400ac-b155-4f51-8d28-97fa4b393052 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.667442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.668086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.668371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.668701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.669536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.669884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.672292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.686159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 256/502] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:26.692463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:26.700177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 247/503] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:26 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/c507723bf8bc4a6aaf7adba0ef25f962/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:26.702147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b63da-6b2b-4232-92b0-57720ba7d8b7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:26.763614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:26.764215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.764497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.764828 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.765725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=d30381ee25fd43ea86c8a6cb53d384a8) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:26.766082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:26.768304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ae34f-dc84-453c-a0b0-7bbd2cd0fcc5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:26.775786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 257/504] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:26 2022] GET /identity/v3/role_assignments?user.id=d30381ee25fd43ea86c8a6cb53d384a8&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:27.616476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197403d6-d61d-4d8e-ba87-c363cf57f29a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.617568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197403d6-d61d-4d8e-ba87-c363cf57f29a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.618103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197403d6-d61d-4d8e-ba87-c363cf57f29a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.620903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 248/505] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:27.628030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.628536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.628694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.654829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:27.656064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:27.667958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 258/506] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:27.705085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197403d6-d61d-4d8e-ba87-c363cf57f29a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:27.720259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197403d6-d61d-4d8e-ba87-c363cf57f29a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:27.729377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:27.730463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.730975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.731459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.747016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:27.754165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:27.755888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 249/507] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:27.762712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:27.774679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564798b8-f032-4cff-aa29-fa5cdb430cdc None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:27.786982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:27.787684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.787972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.788255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.789016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:27.789326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:27.791009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:27.808465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 259/508] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:27.814595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:27.825433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8ed1d-7ec1-457b-a16a-30275dd6c6b7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:27.836762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:27.837862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.838363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.838856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.851472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:27.853738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:27.871302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:27.873120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 250/509] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:27.878987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:27.894761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1fb2-fe86-4d7f-97c4-6f33a5036512 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:27.903865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:27.904546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.904831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.905167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.905931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:27.906247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:27.907900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:27.926183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 260/510] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:27.932110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:27.942315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffdec-7701-4684-9668-b53a32736ed6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:27.949780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:27.950843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:27.951339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:27.951837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:27.960504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:27.963398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:27.977171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:49:27.979032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 251/511] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:27.984948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.000219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ed265-dd9b-4cb8-ab8d-6416f8c23171 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.008265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.008944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.009239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.009519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.010901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.011214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.013067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.041428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 261/512] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.047553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.058278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051504-ee34-48f7-92af-1c6ba61431d8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.069359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.070299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.070816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.071298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.085871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.088652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1282d6-8568-4e8e-bca5-30e64111a0de admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.103599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 252/513] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:28.110144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.123763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7943-edaa-42bf-8179-f0d3d2ea100c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.133955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.135295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.135585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.135871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.157385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.159294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.187621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:28.189125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 262/514] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.195065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.195988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a4e1-1f67-4c31-ba3b-56d88020f879 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.196500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a4e1-1f67-4c31-ba3b-56d88020f879 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.196987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a4e1-1f67-4c31-ba3b-56d88020f879 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.199768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 253/515] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:28.207310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.207591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.208592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.212042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a6d4c-f6fb-4744-bce5-f1052962efb8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.227015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.227708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.227985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.228270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.229543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.229884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.231513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.243028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:28.244809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:28.251971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 263/516] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.259382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.265767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 254/517] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:28.276879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268905fe-e7aa-4154-bdf0-778aa24b51eb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.285459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.286303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.286594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.286874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.293382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.306179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46a5c-e1ef-412d-b343-9535443b9206 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.308767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.310857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.314797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.315627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.315916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.316196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.335362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:28.336872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 264/518] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.337189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:28.343563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.346494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:28.352589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 255/519] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:28.363029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5d31-6ca6-48af-9f77-31f1f9b2dadf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.363998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.375632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a98c2a-744b-4ca5-9a91-75f6cd03b335 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.378329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.378996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.379281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.379560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.380342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.380651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.383078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.396745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 265/520] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.401796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.401796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.401796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.401796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.402132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.402132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.402260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.404943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.417926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 256/521] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:28.426185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.429181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002557ce-b700-4295-b22e-b878e265e2f9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.443407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02c6d2-fa9d-4fdb-a287-f674fbc1c9d7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.444942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.445645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.445957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.446240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.447193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=4799e6d178524148b5aea9a28ddc5145) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.447514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.449549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.457539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 266/522] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/role_assignments?user.id=4799e6d178524148b5aea9a28ddc5145&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.467879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.468754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.469044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.469328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.487077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.489023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.513630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d9fc272f-f7c6-4b31-8eb8-af3512179dfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:28.515292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 257/523] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.521468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.540508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddab09-afc7-4f94-8f95-67584b0de1f8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.555651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.556346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.557163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.557448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.558303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.558622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.560250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.580538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265490c6-47ac-46b1-b8a5-bb911af3c49f None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.582289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265490c6-47ac-46b1-b8a5-bb911af3c49f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.582289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265490c6-47ac-46b1-b8a5-bb911af3c49f None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.584778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 258/524] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:28.589839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 267/525] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.595370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.595656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.595914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.598254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.613506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f18d49-e846-4127-96b6-3b5442c596ed admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.627952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:28.629353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:28.631654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.632584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.632863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.633138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.645999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.648952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.651317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 259/526] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:28.670332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:28.672070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 268/527] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.675786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.678656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.687144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb30af-27ea-4493-8d64-b7cf53b9bee0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.687992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a82ab-ab73-4582-b3ed-4c1ffd3c0467 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.692982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.693905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.694431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.694675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.695028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.695292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.695407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.695935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.696310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.696685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.699136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.710515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:28.720409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 269/528] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.722179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:28.723936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 260/529] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:28.724265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.730015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.740237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b216bb-1fc5-43e2-943a-d3d79d48db24 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.741222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f718d-ca23-4bff-8b21-e6eb0b5c46ff admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.746403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.746915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.747520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.747623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.747985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.748281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.748378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.748822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.749768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.750307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.752159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.757125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.758959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.763122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 261/530] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.769241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 270/531] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:28.769546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.775551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.780469 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1098802-51d4-4775-bcd2-c43cda657572 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.784577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0068d8-896a-4855-844b-89e7923a0770 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.787356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.788445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.788921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.789436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.789671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.790267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.790539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.791354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.802558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.803289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.804391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.805561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.824752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:28.825160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:28.826520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 262/532] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:28.831594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 271/533] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.832562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.833766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.844763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc91b9-ceb5-42e5-8bcb-c1dd8db88857 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.848855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e36a-d122-44dc-92e0-303d16458824 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.850177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.850882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.851241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.851596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.852392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.852793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.854996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.855574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.856480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.857188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.857634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.859072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.859575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.861463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.869860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 272/534] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.875840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 263/535] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:28.880865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.882760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.892240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb4e02-65d7-4faf-970f-99caa2feb761 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.896919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4952f7-dde4-4b36-b32c-c0f918a3b296 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.897695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.898506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.898838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.899125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.904213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.905216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.905705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.906222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.908859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.911439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.916509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.918816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.928231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:28.929425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 273/536] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.934989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:49:28.936287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.941897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 264/537] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:28.946790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.952091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be46885-f7c4-49ff-acdb-ba4e41a43590 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.956634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.957410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.957534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e56d-f183-4c81-b2ae-b9afb723d42b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:28.957913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.958368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.959436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.959835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.962036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.962455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:28.963257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.963581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.963861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.964789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:28.965106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:28.967134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:28.975271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 274/538] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:28.985035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:28.993475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 265/539] 10.222.0.77 () {56 vars in 1158 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:29.001953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.003140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bba5ef-8835-42bc-a5e2-5de6bb5fdcc0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.007633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.008293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.008574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.008852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.009716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.011701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.011916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.016837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006a16a-0813-4e50-811e-262ae52a87f4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.019195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 275/540] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:28 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:29.035425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.036346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.036782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.037231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.050208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.052464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.069278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 266/541] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:29.076070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.092748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209fcda-260a-48f8-9041-4a90baac6cce admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.101107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.102143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.102598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.102967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.124735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.126851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.148478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:29.149805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 276/542] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:29.156655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.170428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271102a4-6df0-428a-8426-3a971c79edb7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.181805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.182750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.183207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.183631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.184532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.185000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.186825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.208424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 267/543] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:29.215364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.227544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb12c-42c6-4145-b010-ac2aa58c2515 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.233478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.234482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.234932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.235423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.242926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.245069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.258927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:29.260657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 277/544] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:29.267425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.280040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a0aa5-1325-4b34-9952-ed2de92a1fd9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.284833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.285663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.286120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.286570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.287509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.287970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.289982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c50b5f-ecb9-4439-84fc-fa614733a5db admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.304023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 268/545] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:29.311023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.321771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172151d5-3e3d-4b28-8de3-6bdf7f9d48a8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.326577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.327389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.327823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.328271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.329238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=f0df50dd209d43f2b2b51267672145f2) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.329697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.331708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0f36-40a0-4784-a614-d273fda707dd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.338574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 278/546] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/role_assignments?user.id=f0df50dd209d43f2b2b51267672145f2&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:29.628374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6359-6a9f-4f10-88bf-41c5ef4244b7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.629258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6359-6a9f-4f10-88bf-41c5ef4244b7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.629691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6359-6a9f-4f10-88bf-41c5ef4244b7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.631830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 269/547] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:29.640622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342e92-2039-4f03-b96a-c759e9feec9a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.641476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342e92-2039-4f03-b96a-c759e9feec9a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.641962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342e92-2039-4f03-b96a-c759e9feec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.666337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f2342e92-2039-4f03-b96a-c759e9feec9a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:29.668064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f2342e92-2039-4f03-b96a-c759e9feec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:29.684368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 279/548] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:29.708447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc6359-6a9f-4f10-88bf-41c5ef4244b7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.717043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b52d9-499a-4bd7-b380-6a85b936d9c2 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.718544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b52d9-499a-4bd7-b380-6a85b936d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.718976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b52d9-499a-4bd7-b380-6a85b936d9c2 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.723826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 280/549] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:29.729842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc6359-6a9f-4f10-88bf-41c5ef4244b7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.733771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.733771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.733771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.741321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.742160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.742444 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.742714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.762398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:29.763973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:29.765319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:29.776608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:29.785866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 281/550] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:29.786479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 270/551] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:29.793194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.802924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6457bc-4c0e-44d3-9cc4-20186a2b4d37 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.810867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.811539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.811818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.812091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.812833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.813141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.814909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.823568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 282/552] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:29.829581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.840213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b00c1-a6ae-40d1-a27f-cdf90e37ff86 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.848306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.849140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.849420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.849740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.851177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.862974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bde3f-f08a-4adf-8f77-372e221d5fcd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.874200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.876844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.877136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.877416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.878838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.882262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.899976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:29.913548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:29.915317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:29.917069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 283/553] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:29.918264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 271/554] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:29.924124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.928674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.939382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d466504-b539-4670-8c97-be9e2b6ed0d4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.939547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9641-2a32-47ae-8212-3493ea0f43e5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.950997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.951724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:29.953157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.953333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:29.953716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.954111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.954483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:29.955329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.955744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:29.956564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:29.957016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.957972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:29.959947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.961004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:29.977956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 284/555] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:29.980849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 272/556] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:29.984799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.994683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0211583-dba9-45fd-97ec-76825f404f34 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:29.999040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:29.999700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.000662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.001105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.001492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.009219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.011492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.019947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fdde-e618-4467-96c5-70c2e7f787e6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.026433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:49:30.028295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 285/557] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:30.034884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.035487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.036392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.037462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.038455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.056010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13837a-e91a-4817-9692-c1736c48a9d6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.059804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.062835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.064842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.066263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.067702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.068091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.069062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.069380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.074703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.102795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:30.104096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 273/558] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:30.105083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 286/559] 10.222.0.77 () {56 vars in 1160 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.111196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.111888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.127688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170b9df-2ea9-4e12-97b2-cd291e0b8d14 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.131365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812aa7b-ee34-4265-81b4-c0b668e5923e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.132630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.133303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.133588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.133943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.134713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.135024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.136723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.147597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.148317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.148603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.148884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.159381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 274/560] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.162718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.164239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.170937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.181084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17739db-96c2-486c-a8dd-642e2675ba11 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.195085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 287/561] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:30.195952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.196716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.200567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.200861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.201144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.214547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb077e-384d-43dd-b69d-256d65b00c72 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.217672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.219728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.225153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.225997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.226287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.226617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.238707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.240620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.246600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:30.248169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 275/562] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:30.257773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.259455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:30.261017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 288/563] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:30.268754 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.278192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d68bb8-8841-4ba6-bef8-6308ca05bfd5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.280494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4dcba-39cb-4a72-bd35-145de4f0d177 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.285143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.285838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.286125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.286403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.287371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.287682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.289395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.295691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.296365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.296648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.296920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.297774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.298090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.299921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.304504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 289/564] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.310554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.321049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ab1cc-9610-4b95-8c74-5c6cc4289b60 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.326263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.327117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.327403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.327687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.335199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.337138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.337341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 276/565] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:30.343694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.354384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:30.355744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 290/566] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:30.359569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853711-ee13-44ed-b019-3414c90ba3f5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.362240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.364499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.365362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.365717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.366141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.372656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705287a3-8e38-4a70-bd87-05e07fca2d5c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.379841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.381738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.382674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.383338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.383621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.383895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.385196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.385511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.387459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.399660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 291/567] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.406536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.406653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:30.414153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 277/568] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:30.416268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f86a-a6f5-4a76-bc5b-405d104f745d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.419996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.420962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.421654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.421982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.422326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.423153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=c507723bf8bc4a6aaf7adba0ef25f962) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.423473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.425363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.432283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 292/569] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/role_assignments?user.id=c507723bf8bc4a6aaf7adba0ef25f962&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:30.441625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94541371-f703-4ca0-9084-8ff2aad1db91 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.455120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.455870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.456206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.456483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.457261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.457578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.459317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.477356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 278/570] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.483591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.493935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e0723-76a0-4602-98f0-5c6e872016fa admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.501487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.502409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.502694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.502971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.511299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.513385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.533045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:30.534652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 293/571] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:30.543061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.555380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4645a13-11f5-4361-bc57-84c8c7d1e0c0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.562537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.563227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.563573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.563860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.564719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:30.565048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.567098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167cf48-6697-41b4-8648-864df54f0531 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.586344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 279/572] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:30.593214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:30.603885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06a4b5-19ac-4b61-931a-00efd5f0ed1b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:30.612913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:30.613901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:30.614191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:30.614476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/d30381ee25fd43ea86c8a6cb53d384a8/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:30.637779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=d30381ee25fd43ea86c8a6cb53d384a8, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:30.640405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0d7aa-d9d0-4c09-9ec4-1fb80fcf3a7f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:30.661204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 294/573] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:30 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/d30381ee25fd43ea86c8a6cb53d384a8/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:31.260264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b402-b656-4864-a8d5-f92cdbcc6881 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:31.260953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b402-b656-4864-a8d5-f92cdbcc6881 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:31.260953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b402-b656-4864-a8d5-f92cdbcc6881 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:31.262939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 280/574] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:31.272456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:31.272754 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:31.273041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:31.294390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:31.295594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:31.354201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 295/575] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:31.409895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490b402-b656-4864-a8d5-f92cdbcc6881 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:31.422763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490b402-b656-4864-a8d5-f92cdbcc6881 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:31.427641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:31.428484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:31.428771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:31.429089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:31.439461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:31.441291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:31.458118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:31.459606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 281/576] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:31.466850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:31.480720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f194413-d098-493e-b3d1-604f47a13662 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:31.489417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:31.490181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:31.490474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:31.490758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:31.491490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:31.491804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:31.493401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f365a-3b4b-4110-813a-577e7c5251ac admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:31.505853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 296/577] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:31.512702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:31.526811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a92910-4b24-491f-91cd-15e7c1de7b84 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:31.533166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:31.533892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:31.534218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:31.534554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:31.535367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:31.537407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d3fd9-470d-4b03-8678-3891b7e32bc2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:31.574575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 282/578] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:31 2022] POST /identity/v3/users => generated 254 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:32.066190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec906c-c57d-4b53-8823-9d25e452291f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.066190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec906c-c57d-4b53-8823-9d25e452291f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.066190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec906c-c57d-4b53-8823-9d25e452291f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.067592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 297/579] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:32.076150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29db5-efeb-437f-abd9-9544e659aea0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.076736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29db5-efeb-437f-abd9-9544e659aea0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.077225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29db5-efeb-437f-abd9-9544e659aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.095977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-98e29db5-efeb-437f-abd9-9544e659aea0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:32.097526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-98e29db5-efeb-437f-abd9-9544e659aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:32.105861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 283/580] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:32.131526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec906c-c57d-4b53-8823-9d25e452291f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.145990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ac61-d015-4daf-845f-2873b32bdc7a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.146612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ac61-d015-4daf-845f-2873b32bdc7a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.147120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ac61-d015-4daf-845f-2873b32bdc7a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.148120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec906c-c57d-4b53-8823-9d25e452291f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.149805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 284/581] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:32.156791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.157597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.157942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.158224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.158600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.159235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.159726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.174836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:32.180740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:32.182626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:32.182968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:32.186268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 298/582] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.191295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.199531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 285/583] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:32.203643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611d88-de4f-4da1-8625-b1eb8dda8d6d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.209351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.210074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.210362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.210643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.211394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.211708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.213362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.225085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.225326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 299/584] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.231615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.235524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2a6d-0453-433f-85bf-79689bddc9b9 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.240324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.241490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.242025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.242206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c296-814d-4025-bc44-393f252de8a7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.242671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.244330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.245572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:32.245572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:32.245572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:32.247102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.247835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.248628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.249881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.252005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.263938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:49:32.266103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 286/585] 10.222.0.77 () {56 vars in 1150 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.274802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.276658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.289561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.298049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:32.300009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 300/586] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.309137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.311859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c09f9-f0a5-4ea0-8fec-85ef35eed6da admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.322802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6b362-75ec-42e3-bfc1-9b96790a8886 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.324763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.325738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.326388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.326880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.327523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.328058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.328325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.328685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.328950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.329056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.329875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.330261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.330642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:32.330642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:32.330642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:32.331882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.331984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.338255 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 287/587] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.348230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.363608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 301/588] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.364517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.375588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecbccf-8a1d-427f-9c21-9657b2dfcd5f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.382204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464dbe-2188-4471-8827-843f90995ad4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.385433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.386150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.386424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.386705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.387412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.387722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.389304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.395765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.396559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.396848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.397125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.402588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 288/589] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.407156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.409203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.434114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:32.435567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 302/590] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.441668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.458641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a747d-a497-47ec-aa15-7d6cb723052e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.467773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.468910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.469396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.469973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.471038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.471614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.473890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.505552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 289/591] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.512388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.530954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f92f0-e3b3-4c1a-b64a-e926f2c005c9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.547168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.547850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.548135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.548407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.563465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.565277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.580293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 303/592] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:32.586012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.602853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461dfc-207b-4fe2-8895-175f70723e9b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.608503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.609575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.610161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.610637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.623242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.625490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.644852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:32.646858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 290/593] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.653568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.663917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532b601-a128-4a6a-a94d-3fcc6c6d8340 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.671090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.672075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.672561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.673157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.674668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.675184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.677254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.691323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 304/594] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:32.698869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.709092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f1d40-55a0-4858-a378-1eaf55e5d5af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.713994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.715075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.715573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.716121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.723593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.725883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.739943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:32.741727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 291/595] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:32.750853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.761622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cae9c8-d881-4aa2-ac40-5b14510b369c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.770232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.771209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.771699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.772251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.773327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.773861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.776679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ab4f2-4dbe-45c4-8a46-6cad724b0bc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.795694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 305/596] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:32.804476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.818322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f64c22-57ab-4118-9392-a5eb5828b372 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.826950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.828000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.828498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.828987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.830076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:32.830701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.832812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1ab4-3e2a-43b5-8fa7-9697581fd5b1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.841387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 292/597] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:33.272546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e306-484d-45b4-920b-dacd643df61b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.273045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e306-484d-45b4-920b-dacd643df61b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.273581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e306-484d-45b4-920b-dacd643df61b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.277842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 306/598] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:33.299825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d62b8-1933-4281-8949-579211b87056 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.301297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d62b8-1933-4281-8949-579211b87056 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.302173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d62b8-1933-4281-8949-579211b87056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.328092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-973d62b8-1933-4281-8949-579211b87056 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:33.329814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-973d62b8-1933-4281-8949-579211b87056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:33.345092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 293/599] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:33.383678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e306-484d-45b4-920b-dacd643df61b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.403008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e306-484d-45b4-920b-dacd643df61b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.407831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.408626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.408912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.409194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.423520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff9ec-9628-4801-ad2e-22ffd10f26f1 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.424046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff9ec-9628-4801-ad2e-22ffd10f26f1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.424333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff9ec-9628-4801-ad2e-22ffd10f26f1 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.425419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:33.426384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 294/600] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:33.433257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-de646499-11ba-468b-8737-7b74bcf1078b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:33.434953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 307/601] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:33.441431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ff9ec-9628-4801-ad2e-22ffd10f26f1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.443010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.443641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.444131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.463623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ff9ec-9628-4801-ad2e-22ffd10f26f1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.467277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:33.468790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:33.469448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.470198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.470484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.470765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.471551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:33.476927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.476927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.489221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 308/602] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:33.490147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 295/603] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:33.496693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.513487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.521423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fe783-2b3f-4844-8076-ee6a6e775d6b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.526252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb70bb1-2681-4d64-b962-a424c764cf3f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.531847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.532645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.532925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.533198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.536259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.537034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.537313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.537594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.538256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.539839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.551622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.553438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.560863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:49:33.562488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 296/604] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/services/network => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:33.580064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.584811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:33.586362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 309/605] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:33.595728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.596884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbccf5-9f2b-4904-8d20-5709e0775f5e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.606823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aeb5a-b0c9-415f-8f55-50306fb5e0f2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.611400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.612083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.612374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.612655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.613369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:33.613683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.615820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.618862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.619532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.619816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.620097 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.620818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:33.621128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.622733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.634330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 297/606] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:33.643083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.649608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 310/607] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:33.657549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.658913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1c1c-ec06-4f57-b249-2f7d070aaa65 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.672108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.672805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.674461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.674748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.675465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:33.676808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.677635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc70d-b863-4b9b-ac2c-eadb875f32e9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.679778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.687798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.689900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.690186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.690830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.692277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 298/608] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:33.709464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.711575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.730188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:33.731723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 311/609] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:33.744869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.759252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd22ab-bd5a-47e8-9c30-ef54bece6c44 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.778753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.779370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.779657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.779935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.780786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:33.781098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.783009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.811054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 299/610] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:33.817370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.832692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0f1f5-06b4-41c2-ba46-68ff1eca7538 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.851526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.852206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.852492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.852773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.866045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.867839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.883654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 312/611] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:33.890936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:33.905572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a862-3dcd-4ac9-9e3e-70a90d584708 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:33.925808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:33.925808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:33.925808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:33.925808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:33.951712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:33.951712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:33.973691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:33.986700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 300/612] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:33.999640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:34.012056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df671d0-e9ff-445c-9b56-796280662346 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:34.020382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:34.021063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.021349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.021631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.024821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:34.025191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:34.026832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:34.045280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 313/613] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:34.052247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:34.063482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a4257-10b2-4c16-9d44-92133eb4067f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:34.068240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:34.069214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.069655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.070095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.077807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:34.081344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:34.095008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:34.101872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 301/614] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:34.107135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:34.135958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6517-23ea-4010-b8d5-2b3cb8d7bd6c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:34.155091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:34.155929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.156326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.156736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.157645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:34.158204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:34.160141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f3dea-621a-456f-b63e-1bf47b5b97d8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:34.184446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 314/615] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:34.191463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:34.215576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514a19-b091-47b2-a0b0-e2c9ce42ba1e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:34.226563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:34.227495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.227920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.228910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.229997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=d30381ee25fd43ea86c8a6cb53d384a8) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:34.230496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:34.232765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876072fb-6722-4dc0-afd3-fbe049f88804 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:34.248814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 302/616] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:34 2022] GET /identity/v3/role_assignments?user.id=d30381ee25fd43ea86c8a6cb53d384a8&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:34.918594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ad95-5cd7-4dfc-964c-665ca58c5410 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.919552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ad95-5cd7-4dfc-964c-665ca58c5410 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.920081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0ad95-5cd7-4dfc-964c-665ca58c5410 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.922549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 315/617] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:34.931694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f526bf-4603-42d3-b997-6e412ce0c561 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.932654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f526bf-4603-42d3-b997-6e412ce0c561 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.933158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f526bf-4603-42d3-b997-6e412ce0c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.953008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-01f526bf-4603-42d3-b997-6e412ce0c561 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:34.954633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-01f526bf-4603-42d3-b997-6e412ce0c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:34.969853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 303/618] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:34.987968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0ad95-5cd7-4dfc-964c-665ca58c5410 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.001302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0ad95-5cd7-4dfc-964c-665ca58c5410 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.005653 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.006474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.006755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.007029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.018355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:35.025822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:35.031758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 316/619] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:35.033543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5969dc-07c0-4d3b-80e9-820f0a73c3d2 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.033849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5969dc-07c0-4d3b-80e9-820f0a73c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.034128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5969dc-07c0-4d3b-80e9-820f0a73c3d2 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.036091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 304/620] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:35.036213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.050742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5610b-ab2e-4198-8bd4-76799208e9fc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.055283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.055283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.055283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.059434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.060114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.060400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.060681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.061436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.061802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.063375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.076981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:35.078114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 317/621] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:35.078221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:35.084441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.090138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 305/622] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:35.100250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b944bc-4f44-4515-a628-16f4351901ab admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.104881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.105682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.106011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.106295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.117029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.119421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.123548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.133977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f15e7c-9669-47c0-8d6a-7927aede3c11 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.139061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:35.139731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.140628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.140734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 318/623] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:35.141241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.141836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.142762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.143978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:35.143978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:35.143978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:35.145254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.146584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.159075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0b695-765d-490a-bf57-836ed2f05055 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.167637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 306/624] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:35 2022] POST /identity/v3/services => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:49:35.206674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.207372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.207658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.207936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.208674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.208981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.210624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.224400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 319/625] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:35.231020 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.247759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3392f8-d982-428b-811d-c70e209cae12 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.255234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.256071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.256356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.256632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.273436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.273436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.299029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:35.300615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 307/626] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:35.308372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.323809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae283f-00e7-4832-b6be-47629df3a0d2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.333073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.333783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.334076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.334357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.335210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.335523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.337380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.363855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 320/627] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:35.369924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.383086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939c52-cd1f-4cfe-bb89-84d7a32bbb30 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.391658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.392344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.392630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.392907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.406273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.408098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65809f64-e4c7-471b-938f-1cede1c07c01 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.420764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 308/628] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/auth/tokens => generated 1171 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:35.427537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.443245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf49530-0b94-452e-8d5e-99daf168a9c5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.453009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.453853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.454138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.454418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.474026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.475809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.501292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:35.501617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd428-2f68-4659-9e2d-2fefea27dc8c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.501825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd428-2f68-4659-9e2d-2fefea27dc8c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.501994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd428-2f68-4659-9e2d-2fefea27dc8c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.502804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 321/629] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:35.504051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 309/630] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:35.508690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.512215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.512509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.512794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.521109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a81d6-1c28-4e62-867c-a3a5bc964e8d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.528905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.529585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.529897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.530176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.530907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.531218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.532833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.534583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:35.535844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:35.553138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 310/631] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:35 2022] POST /identity/v3/auth/tokens => generated 1171 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:35.554449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 322/632] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:35.560952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.574908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd063d-5588-4ee4-ab78-e8790e8a0c0b None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.578056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.588508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.588508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.588508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.588508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.589205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18bea-69ff-4aef-a0b3-5751c25e7936 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.596169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.598402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.599740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.600535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.600821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.601098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.613722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:35.615497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 311/633] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:35.622311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:35.622795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.629221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:35.630726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 323/634] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:35.633772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68631ec5-0480-4d1a-859a-84fb29ab4642 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.637705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.639803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.640717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.641226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.641797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.643072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.643588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.646558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.647985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31f38-0ad8-4f8a-863c-cb541bd92817 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.657196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.657876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.658160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.658432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.659172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.659480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.660795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 312/635] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:35.661153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.667262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.671300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 324/636] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:35.679237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.681121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bfd88-dd33-4bdf-9bad-68486be780f7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.688352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.689064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.689350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.689630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.689729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51527ebb-c6fc-43e7-99a4-204973678e04 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.690554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=ebc8afdc24134704b8c92eb749bca94d) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.690982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.693035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.694623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.695577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.695862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.696559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.699176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 313/637] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/role_assignments?user.id=ebc8afdc24134704b8c92eb749bca94d&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:35.710227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.712128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.730667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:35.732202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 325/638] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:35.738201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.752417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bbfef-5271-43e0-84c9-684ce9f87c66 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.757374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.758192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.758552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.758903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.759805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.760186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.761927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.776789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 314/639] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:35.782810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.792817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cd5d-7e30-4380-91b5-72e083cf08be admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.802068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.802887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.803168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.803441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.812969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.815103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.836616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:35.842073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 326/640] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:35.848419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.858686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd77f-ec6d-43b6-9d2f-20f303162cde admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.865955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.866643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.866924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.867197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.868040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.868352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.870814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.896746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 315/641] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:35.902785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.912619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fff54c-5f42-4db3-af64-b8ee8c5638bd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.920742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.921547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.921860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.922137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.934791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.936642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:35.957975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:35.959177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 327/642] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:35.965396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:35.978785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241655-4e7e-4026-9be1-b8ffbbc2241d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:35.987324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:35.987931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:35.988208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:35.988480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:35.989199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:35.989502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:35.991124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:36.008397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 316/643] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:36.014600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:36.026615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bce46-6ca4-4eab-a821-8b3419110cde admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:36.034358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:36.035149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.035429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.035701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.050903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:36.053115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:36.069096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:36.070292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 328/644] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:36.076660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:36.086338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62739e-6615-436f-a32b-48fb1283b47a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:36.093715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:36.094391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.094671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.094943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.095721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:36.096028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:36.097896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167097-9478-486f-a328-4c194ea77291 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:36.113646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 317/645] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:36.120103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:36.134648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c60f8-0c4a-4586-94bd-a591e907977b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:36.142369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:36.143257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.143535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.143805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.145817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=77efb1f35bc948b1b218f0ae9deca0f9, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:36.148402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5cbc9-ecaa-431f-8d81-aa0c99e28bf8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:36.166360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 329/646] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:36 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:36.665836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598192-1d3a-47ae-9bab-7d0f71c251e7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.666264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598192-1d3a-47ae-9bab-7d0f71c251e7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.666659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598192-1d3a-47ae-9bab-7d0f71c251e7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.668799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 318/647] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:36.676933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e832a3-6e64-4dd9-b4e3-d6c3a6f5c581 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.677355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e832a3-6e64-4dd9-b4e3-d6c3a6f5c581 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.677738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e832a3-6e64-4dd9-b4e3-d6c3a6f5c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.696511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b1e832a3-6e64-4dd9-b4e3-d6c3a6f5c581 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:36.698483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b1e832a3-6e64-4dd9-b4e3-d6c3a6f5c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:36.757172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 330/648] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:36 2022] POST /identity/v3/auth/tokens => generated 1171 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:36.781674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94598192-1d3a-47ae-9bab-7d0f71c251e7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:36.794503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94598192-1d3a-47ae-9bab-7d0f71c251e7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:36.799123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:36.799898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:36.800286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:36.800665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:36.801781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:36.803535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a17db-3ef9-485d-adca-83d28b01d406 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:36.818701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 319/649] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:36 2022] POST /identity/v3/services => generated 240 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:37.450273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cd0f-c1b9-47ed-a19d-157894b62bb5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.450810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cd0f-c1b9-47ed-a19d-157894b62bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.450810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cd0f-c1b9-47ed-a19d-157894b62bb5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.453077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 331/650] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:37.466782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.467252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.467349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.490765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:37.491982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:37.511680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 320/651] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:37 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:37.548374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784cd0f-c1b9-47ed-a19d-157894b62bb5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.563451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784cd0f-c1b9-47ed-a19d-157894b62bb5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.570345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.571145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.571430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.571706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.586652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:37.593909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:37.595391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 332/652] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:37.601677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.611387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a9cc2-f943-454c-9018-15f4b585fb4a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.621979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.622644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.622930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.623211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.623955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:37.624264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.625876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.642536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 321/653] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:37.648833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.662645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667109-dcb0-4958-8e0c-ad52127dc411 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.670293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.671084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.671367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.671642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.693493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.695414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.716168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:37.717683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 333/654] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:37.723763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.735441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d60f-36e6-4578-9a80-351b42adc10d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.746859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.747535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.747818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.748096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.748827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:37.749137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.750762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.768859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 322/655] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:37.775315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.791132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803cbf0-0945-44c3-b24d-9ce3842e3746 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.799772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.800513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.800801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.801334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.814895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.816916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.833088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:37.834591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 334/656] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:37.840694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.853628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050370e-b0a1-41bd-8403-6ed660b10e84 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.862409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.863102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.863387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.863668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.864533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:37.864846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.866778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.888088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 323/657] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:37.894521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.906740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a1d3-5378-4894-a9f2-f2d7e5232570 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.913843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.914489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.914771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.915056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.929840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.931689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.943280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 335/658] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:37.950243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.960425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd63b35-c119-403e-8143-b31a811903dd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.967057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.967854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.968132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.968403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.985368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.987215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.012394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:38.013994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 324/659] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.020062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.034721 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac591-cd1f-41e6-aa47-45858a00f2de admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.046410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.047095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.047382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.047662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.048387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.048695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.050358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.069914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 336/660] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.076001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.089776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b96c9b-45bb-4651-b33e-3ea228b835cb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.097985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.098786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.099065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.099336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.115254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.117223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.141522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:38.143119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 325/661] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.149557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.163937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949cd0-5377-4673-a34c-fe2aec9c7eca admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.173916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.174588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.174871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.175145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.175926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.176489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.178348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccdc40-5a57-439b-a64c-4bb9e1ab23b2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.198969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 337/662] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.205596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.218565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1af1-569f-4086-885b-0ac262e6a7c1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.230959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.231774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.232059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.232332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.233150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=d30381ee25fd43ea86c8a6cb53d384a8) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.233455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.235555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdce2-9da5-4d2b-9a6c-7136b0594cd5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.241707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 326/663] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/role_assignments?user.id=d30381ee25fd43ea86c8a6cb53d384a8&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.256775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a297b-588a-41cc-8ed7-4373fccbfc00 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.257088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a297b-588a-41cc-8ed7-4373fccbfc00 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.257340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a297b-588a-41cc-8ed7-4373fccbfc00 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.259448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 338/664] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:38.270535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.270535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.270535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.299934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:38.301458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:38.314781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 327/665] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:38 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:38.357720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a297b-588a-41cc-8ed7-4373fccbfc00 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.378786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a297b-588a-41cc-8ed7-4373fccbfc00 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.385291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.386189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.386542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.386825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.387499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.388583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:38.388583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:38.388583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:38.389550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.408487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-70f509b0-a4f0-4ebf-8b88-ed91285d896c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:49:38.409944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 339/666] 10.222.0.77 () {56 vars in 1150 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.419153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.436986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945387-afe3-4897-9582-99b226f2b299 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.441272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.442253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.442768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.443302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.444208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.444771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.446693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.455332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 328/667] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.457140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dddc-6d45-4130-b063-3c3dd563b5ac None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.457565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dddc-6d45-4130-b063-3c3dd563b5ac None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.457565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45dddc-6d45-4130-b063-3c3dd563b5ac None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.459412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 340/668] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:38.464292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.466642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.466931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.467395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.473977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed90f-3fc1-4432-9600-d3d3276589cc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.484697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.485405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.485688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.486028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.486733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.487090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.488798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.498809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:38.499858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 329/669] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.500060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:38.501036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.511745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de552a-0045-4abd-b01e-7a3ed881cb6c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.516501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.517144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.517466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.517773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.518594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] RBAC: Adding query filter params (interface=public, service_id=468dca0b935948919fa35eb8391aed54, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.518904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.520208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:38.520208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:38.520208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:38.521136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.524564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 341/670] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:38 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:38.534851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 330/671] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/endpoints?service_id=468dca0b935948919fa35eb8391aed54&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.540894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.554960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccae47-cb3d-4703-b21a-1f2c9ec4572d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.559545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.563044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.563779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.564069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.564351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.565332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.567086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:38.567086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:38.567086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:38.568039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.573440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28412975-89fb-4662-ba4c-8aed11cee625 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.579112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 342/672] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.590159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.591001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.591342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.591625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.608971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:38.616364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:38.617993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 331/673] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:38.624771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.637118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd56321-b07f-4cae-becb-88776b62c737 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.643466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.644222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.644508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.644803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.645611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.645956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.647742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.661355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 343/674] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.668116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.679544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cb946-c93e-434d-ae8d-ad249f7491a3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.690464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.691318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.691717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.691999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.704240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.706221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.727574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:38.729726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 332/675] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.735960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.747938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eeac8-231e-48a4-94f0-3d0efd0a6b0a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.755444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.756190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.756480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.756858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.757601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.757939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.759764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.780106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 344/676] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.786190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.796666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad935e-45ec-44c5-982b-299644f368ea admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.803156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.803966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.804253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.804534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.812427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.814437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.828903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:38.830404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 333/677] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.836301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.847313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10a89-3a75-4f58-9718-b27e50104323 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.851796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.852456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.852738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.853071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.854435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.854740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.856580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.874351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 345/678] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.880644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.890270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98695fb3-a771-4167-8e35-a7a2ddf4e9ec admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.894816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.895597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.895874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.896142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.907742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.909574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.926987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:38.928155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 334/679] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:38.934454 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.944058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d761c7f-a787-4a86-bef7-cbd1238362ff admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.949487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.950141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.950422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.950695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.951404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:38.951711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.953293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:38.965243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 346/680] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:38.971437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:38.982487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257677-a9be-47c9-945f-6154bf87f128 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:38.986936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:38.987718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:38.988000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:38.988276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:38.995127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:38.997081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.009888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:39.011207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 335/681] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:39.017370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.028186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dca3a-9f31-4765-9f71-ccb33c018cf9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.032969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.033654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.033970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.034249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.035061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.035369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.037283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011bb0c-7918-4a96-903b-9b2a24eead91 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.050779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 347/682] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.058135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.068903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eff55-9b8b-4553-a06c-e041558d002f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.073530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.074689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.074975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.075249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/ebc8afdc24134704b8c92eb749bca94d/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.090818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=ebc8afdc24134704b8c92eb749bca94d, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.093566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479fe3c-c301-42de-b05f-cc3a8ccb2b12 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.110145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 336/683] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:39 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/ebc8afdc24134704b8c92eb749bca94d/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:39.202143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79819-f45b-4731-a347-49664f70503e None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.202486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79819-f45b-4731-a347-49664f70503e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.202689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79819-f45b-4731-a347-49664f70503e None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.204604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 348/684] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:39.213154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.213505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.213808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.233621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:39.235074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:39.319012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 337/685] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:39 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:39.341342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c79819-f45b-4731-a347-49664f70503e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.356201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c79819-f45b-4731-a347-49664f70503e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.360601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.361442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.361724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.362074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.373477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:39.380822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:39.382048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 349/686] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:39.388854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.397908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33137-4429-4d1a-8caa-38809fbac986 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.402712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.403422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.403704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.403977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.404706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.405009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.406667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.415233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 338/687] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.421991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.432811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6500-1887-4503-b90d-7674ca8c83b4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.437415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.438281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.438562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.438838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.450251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.452128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.470945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:39.472141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 350/688] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:39.479429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.495292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331227-2c8a-4d7a-877b-37dae0891236 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.500654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.501328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.501612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.501933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.502652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.502964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.504552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.531270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 339/689] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.537843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.548846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07360-49ae-4849-9cd3-88d2776fe1ca admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.562130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.563224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.563680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.564167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.575709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.577995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.599892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:49:39.601333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 351/690] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:39.608510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.625181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d1a5-066e-4e7c-a34d-80cf8d157736 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.636665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.637365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.637649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.637959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.638819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.639139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.641043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.673290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 340/691] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.680399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.690911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84f6d-6223-44d3-89fb-d3f255a7fe57 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.701596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.702610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.703092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.703664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.718295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.720436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.737771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 352/692] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:39.737949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.760178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16492950-8ef0-4376-a843-b2d890a3442d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.767967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.769032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.769596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.770093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.782257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.784392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.801943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:39.808452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 341/693] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:39.810840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.820102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e511c7-7ef3-469a-baca-a11676d41fbc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.829525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.830424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.830902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.831387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.832287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.832850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.834688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.852944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 353/694] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.859532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.870272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3d61-4e4c-4e4b-bd37-153964246896 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.878908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.879988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.880472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.880970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.888711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.890986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.904822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:39.909977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 342/695] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:39.913257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.923435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee0b0-6262-46db-8612-038b20481711 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.933484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.934462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.934942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.935460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.936420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.936969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.939147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778f18a-539b-4003-b783-c851d10d7feb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.957152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 354/696] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:39.964632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:39.976487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254d78-abb2-48c3-ad2c-604d2f65a007 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:39.986389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:39.987590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.988113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.988578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.989697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:39.990223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:39.992352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73519-864f-496f-9b62-8fb81b2ae0bf admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:39.999736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 343/697] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:39 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:40.048670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e268c-2a4c-4e53-b008-983957cabea8 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.049093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e268c-2a4c-4e53-b008-983957cabea8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.049477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e268c-2a4c-4e53-b008-983957cabea8 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.051634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 355/698] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:40.062857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.063821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.064103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.098366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:40.099516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:40.113460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 344/699] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:40 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:40.157313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e268c-2a4c-4e53-b008-983957cabea8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.178621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e268c-2a4c-4e53-b008-983957cabea8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.183558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.184385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.184672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.184951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] PATH_INFO: `/v3/services/network` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.185627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.191378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.203353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:49:40.204540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 356/700] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:40.211213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.221604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7acdd-793a-4bab-a33e-8314f5427b38 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.228962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.229639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.229948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.230228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.230941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:40.231252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.232847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.240858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 345/701] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:40.246832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.259744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736ff3-0711-41c3-8c84-7e9f0e67e0cf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.265708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.271187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.271479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.271766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.272484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:40.272798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.274472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.282065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 357/702] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:40.287937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.298118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c92b5-4f8f-4fa9-9438-695d6693d553 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.303231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.303974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.304391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.304831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.305857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] RBAC: Adding query filter params (interface=public, service_id=72a2492582b8420290352f6d33ff330f, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:40.306801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.308750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedab5c-457f-4df1-80b1-b12fc8c33e52 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.314651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 346/703] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/endpoints?service_id=72a2492582b8420290352f6d33ff330f&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:40.320218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.335559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78231-202d-477e-b183-adb686442b4e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.340809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.341568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.341910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.342223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.342907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.344543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca79367-4237-4712-9374-20dec53c35fc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.350508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 358/704] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:40.846085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300ac6-9bbd-44e4-8ea0-6cf64ca82b2d None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.847119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300ac6-9bbd-44e4-8ea0-6cf64ca82b2d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.847609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300ac6-9bbd-44e4-8ea0-6cf64ca82b2d None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.849895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 347/705] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:40.858189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.858724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.858724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.879335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:40.880523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:40.891902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 359/706] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:40 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:40.921404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300ac6-9bbd-44e4-8ea0-6cf64ca82b2d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.939310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300ac6-9bbd-44e4-8ea0-6cf64ca82b2d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.947452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.948491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.948968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.949438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.960131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:40.967057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:40.968767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 348/707] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:40.974962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.988773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c961e4-3f53-4d37-9455-1c170679e6cf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.997507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.998252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.998543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.998822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.999629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:40.999939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.001577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.016100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 360/708] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:41.022590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.039257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdec59-d03c-44c8-a041-1fb1695b87fc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.044053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.045046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.045524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.046019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.063800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.066028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.087489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:41.089266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 349/709] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:41.095187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.114508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22dbd3-41a7-4b80-8d71-24a5523a7f6a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.120628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.121303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.121616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.121920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.122682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.122991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.124641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.144634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 361/710] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:41.151424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.167123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e840ce-f494-4f48-8f21-05a6590bf229 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.178296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.179474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.179953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.180423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.193793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.197327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.216941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-15e9b61f-5c40-4f2f-8426-d0eead715a62 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:41.218546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 350/711] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:41.224584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.239178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dd25b-9f10-434a-bf7e-7755b25b621b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.255529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.256273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.256563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.256844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.257741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.258140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.260787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.283002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2faef6-0795-433e-b241-13bce8ecea44 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.283290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2faef6-0795-433e-b241-13bce8ecea44 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.283573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2faef6-0795-433e-b241-13bce8ecea44 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.285611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 351/712] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:41.290243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 362/713] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:41.292921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.293210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.293493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.297674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.312221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb7997-ff0a-418a-b762-7d6fdcc7ab5d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.321008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:41.322820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:41.323808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.324682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.325011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.325257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.332097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 352/714] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:41 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:41.342937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.344860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.366848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:41.368369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 363/715] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:41.376788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.386959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbeab-a1d3-4c95-8123-85a1682bd5df None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.392692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.404155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.404891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.405179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.405463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.406269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.406581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.411507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.411690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60b71-742d-4155-9f3b-368ccc894d90 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.417144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.418082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.418371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.419055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.419357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.421186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.431173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 353/716] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:41.433379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:49:41.434862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 364/717] 10.222.0.77 () {56 vars in 1150 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:41.441427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.441551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.452233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38fd4-1b79-4fcc-8472-12310e09d6c1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.461880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118494-1674-4424-9642-d3acd8aedd5d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.464390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.465056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.465398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.465680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.466507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.466821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.469477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.472496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.473289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.473573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.474539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.480863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 365/718] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:41.486595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.496272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.498355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.506215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0e9d-4ecd-4f13-8563-a6a11d7b77cb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.518682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.519368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.519636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:41.519741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.519901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.520615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.520924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.521226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 354/719] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:41.522539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.531707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.539873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 366/720] 10.222.0.77 () {56 vars in 1145 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:41.541900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.549693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c0271-baa7-4f70-be49-5550f9f61517 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.555910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1775-7321-44d9-a3f9-1739caa5c22d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.561065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.561737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.562059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.562339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.563127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:41.563441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.565303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.569019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.569692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.570013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.570287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.571046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.572583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:41.572583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:41.572583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:41.573454 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b42ff6-62e7-47a5-a0cc-fb2bcbd63c82 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.588866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 355/721] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:41.600010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:41.614094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1969b-f769-4447-8139-7c875ce2e067 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:41.616204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 367/722] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:49:41.630864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:41.631727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:41.632065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:41.632346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/d30381ee25fd43ea86c8a6cb53d384a8/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:41.635081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=d30381ee25fd43ea86c8a6cb53d384a8, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:41.638056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00eea5-0fb6-45a1-af46-bb1d5a260770 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:41.653656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 356/723] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:41 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/d30381ee25fd43ea86c8a6cb53d384a8/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:42.070713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d101-0fae-48df-88a2-aa26bbf05b28 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.071408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d101-0fae-48df-88a2-aa26bbf05b28 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.071408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d101-0fae-48df-88a2-aa26bbf05b28 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.073386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 368/724] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:42.081095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.081655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.081655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.101480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:42.102723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:42.161640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 357/725] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:42 2022] POST /identity/v3/auth/tokens => generated 1456 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:42.186267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d101-0fae-48df-88a2-aa26bbf05b28 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.199232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d101-0fae-48df-88a2-aa26bbf05b28 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.203634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.204420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.204704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.204983 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.216817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:42.225493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:42.227003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 369/726] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:42.234054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.243350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187a4a-593d-4574-aaed-41415e357ee2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.248816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.249486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.249785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.250068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.250814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.251119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.252706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.261491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 358/727] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.270069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.280293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1d08-6cd6-4134-ac38-136d7ed9b921 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.284966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.285832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.286107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.286437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.303738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.305586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.323041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:42.324475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 370/728] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:42.330823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.340744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05d35-8178-4479-a56e-f6cb0c6131ff admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.348762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.349416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.349770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.350075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.350791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.351167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.352794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.377416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 359/729] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.385623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.400921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3397f-fec4-46f7-b8d9-7a45f8f7b26c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.406568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.407433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.407718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.407997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.417986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.420182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.445769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:42.447647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 371/730] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:42.454029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.470212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699e443-e8dc-4fda-9e04-65fb2dc4333f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.479032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.479697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.480034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.480312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.481201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.481550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.483474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.510123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 360/731] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.516242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.526892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1662bd-82c2-4e60-805a-c0cdec1459e0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.531572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.532218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.532503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.532835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.545611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.547424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.563513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 372/732] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/auth/tokens => generated 1456 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:42.569836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.580239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8750c-1c33-49fd-812f-bc84d83f83df admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.584974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.585774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.586127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.586403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.597733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.599815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.616933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:42.618445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 361/733] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:42.625279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.634447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6ab38-52e8-4465-9788-8d7b7c0c292d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.639064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.639771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.640065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.640343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.641116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.641431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.643059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.665552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 373/734] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.673597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.686137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640b5d-6a30-4c92-8e28-5d28045b4df0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.695024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.695832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.696163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.696440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.705414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.707467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.727224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:42.729212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 362/735] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:42.735393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.748222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bea-b2cc-47d7-88c3-d66bb844f9c5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.753682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.754437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.754723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.755001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.755832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.756145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.758169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf3ea5-817c-4de9-a3a8-e987bdb382f5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.771003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 374/736] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.778270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.789029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259765f-6152-4dc0-9fbf-95c58fdac2f9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.794479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.795130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.795464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.795741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.796615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=ebc8afdc24134704b8c92eb749bca94d) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:42.796927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.798835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106bbb-6ad1-47d7-aab5-8d0cc52528f5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.805855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 363/737] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/role_assignments?user.id=ebc8afdc24134704b8c92eb749bca94d&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:42.943242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047989fc-d006-48a1-98ce-3f08929a49e5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.943582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047989fc-d006-48a1-98ce-3f08929a49e5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.943799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047989fc-d006-48a1-98ce-3f08929a49e5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.945888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 375/738] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:42.954330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.954626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.954881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.978930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:42.980177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:42.995325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 364/739] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:42 2022] POST /identity/v3/auth/tokens => generated 1456 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:43.035585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047989fc-d006-48a1-98ce-3f08929a49e5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.050069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047989fc-d006-48a1-98ce-3f08929a49e5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.055222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.056296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.056586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.056866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.057533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.059184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.078495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:49:43.080009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 376/740] 10.222.0.77 () {56 vars in 1153 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:43.086241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.095701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f796f-8853-4b3c-aa04-a0240d375610 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.110510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.111263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.111553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.111837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.112560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:43.112872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.114572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71f73-087a-40ae-bf47-a17f63be6dfd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.120285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 365/741] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:43.126921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.136961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f422c3-4ca4-43c8-80ea-febeddbb9a34 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.141634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.142426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.142822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.143204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.144015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:43.144428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.146176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddff5ee-a3c4-448c-ae09-6bee3b824fdd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.151588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 377/742] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:43.283141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505306fe-90e4-4e6c-88dd-f2be81a8abcf None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.283805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505306fe-90e4-4e6c-88dd-f2be81a8abcf None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.284284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505306fe-90e4-4e6c-88dd-f2be81a8abcf None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.287068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 366/743] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:43.295133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.295482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.295702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.321950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:43.323306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:43.339651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 378/744] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:43 2022] POST /identity/v3/auth/tokens => generated 1456 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:43.365203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505306fe-90e4-4e6c-88dd-f2be81a8abcf None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.380638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505306fe-90e4-4e6c-88dd-f2be81a8abcf None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.387836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.389253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.389853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.390569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] PATH_INFO: `/v3/services/network` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.391893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.393825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.406831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:49:43.408231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 367/745] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:43.414860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.426986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed9a7-2adc-4126-b38a-75375ae8dec8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.438116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.438788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.439077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.439360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.440074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:43.440387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.442015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.450285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 379/746] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:43.456320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.466330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b15d-75b7-4e1b-b6e7-8110ea9853de admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.471098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.471991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.472474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.472964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.474089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:43.474610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.476448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b51534-ac74-4121-a276-fa1c5ef88ee4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.481993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 368/747] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:43.489866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:43.502611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6df1a-4dc2-4790-ac97-81d7a643151b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:43.510439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:43.511100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:43.511387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:43.511666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:43.512410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:43.514020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36876639-04cf-490a-970f-c48c94e0ebcd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:43.537654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 380/748] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:44.411265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff594f2-2d82-4d72-be65-745f5f9e5fd1 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.412311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff594f2-2d82-4d72-be65-745f5f9e5fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.412803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff594f2-2d82-4d72-be65-745f5f9e5fd1 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.415287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 369/749] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:44.424276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.425473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.426030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.444167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:44.445655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:44.462681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 381/750] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:44.482854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808723a-a4e6-4b16-8297-1b56f96f350b None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.483451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808723a-a4e6-4b16-8297-1b56f96f350b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.483928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808723a-a4e6-4b16-8297-1b56f96f350b None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.486383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 370/751] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:44.486919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.496719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568738b-a0a4-45bc-86fa-01248ea40f15 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.498884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8300c2-821a-4559-9647-665f74619146 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.499418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8300c2-821a-4559-9647-665f74619146 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.499901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8300c2-821a-4559-9647-665f74619146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.501733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.502608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.502896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.503177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.503845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.505478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.517627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:49:44.520719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9d8300c2-821a-4559-9647-665f74619146 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:44.522144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9d8300c2-821a-4559-9647-665f74619146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:44.524515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 382/752] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:44.525888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.531881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 371/753] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:44.538640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce61a-cd30-4969-af86-7efe497aff27 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.543925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.544823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.545307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.545832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.546738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.547245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.549066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.554595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 383/754] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:44.559497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8300c2-821a-4559-9647-665f74619146 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.562726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.569372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8300c2-821a-4559-9647-665f74619146 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.573173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d69036-fc85-4af7-8f89-234f32755900 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.575095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.576042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.576327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.576603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.578791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.579656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.580174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.580655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.581553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.582091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.583887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.588473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:44.588927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 384/755] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:44.595499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:49:44.597092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 372/756] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:44.604708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.615342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271a28-f5f9-4733-a37c-19b5c4c94e2b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.620247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.620938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.621223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.621508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.622324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.622632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.624244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.636559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 385/757] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:44.643134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.653671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60052-cdfd-49d9-86cc-39a92dd69db5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.658767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.659582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.659867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.660145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.672904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.675031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.693200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:44.694782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 373/758] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:44.701890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.712313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356ad4-4ea1-4955-bdc9-8b3852f5bde7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.716960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.717645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.718133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.718420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.719155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.719463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.721077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.734728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 386/759] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:44.741005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.751477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eee02-ef13-4426-8659-5ad894fb0d47 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.756913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.756913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.757268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.757431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.766383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.768403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.782165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:49:44.783586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 374/760] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:44.789905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.799817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215a3a-8d53-4dea-9ea3-c56db3b9a27a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.804614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.805296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.805580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.805936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.807421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.807733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.809567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.827865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 387/761] 10.222.0.77 () {56 vars in 1156 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:44.834507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.845066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2ca1-591d-43e0-816a-9074d3277452 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.850148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.851086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.851622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.852101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.860914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.863078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.873605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 375/762] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:44.881857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.891841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9a5c-c89e-4e85-963f-ff2ac9a43977 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.896525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.897377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.897662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.898008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.909556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.911475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.929340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:44.930862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 388/763] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:44.937642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.946739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b04c6-75c4-47e5-833d-32f313c5463b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.951473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.952133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.952416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.952693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.953410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:44.953720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.955435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.968805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 376/764] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:44.975077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.985420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006138-c004-4773-9c39-07f5d523ac82 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.990198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.990988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.991319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.991594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.999451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.001452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.014678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:45.016167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 389/765] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:45.022672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.033370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63919a47-9ec4-430b-b65d-61b93ebd423e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.038088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.038741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.039076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.039355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.040136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:45.040563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.042591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a72ade-d568-448e-8a25-12cd2743e414 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.054987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 377/766] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:45.062277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.073161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0cb0c-9986-4526-b11c-d2e6d21d8e7a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.078057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.078762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.079152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.079434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.080307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=d30381ee25fd43ea86c8a6cb53d384a8) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:45.080621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.082604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9e899-907f-4c14-8670-c647b8626b93 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.089701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 390/767] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/role_assignments?user.id=d30381ee25fd43ea86c8a6cb53d384a8&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:45.431420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587965-462c-4e59-9c4f-806ac47d26fe None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.432091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587965-462c-4e59-9c4f-806ac47d26fe None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.432091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587965-462c-4e59-9c4f-806ac47d26fe None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.434252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 378/768] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:45.441704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9167aa-a956-4077-a9ff-8a3ba1fb88f7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.442261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9167aa-a956-4077-a9ff-8a3ba1fb88f7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.442261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9167aa-a956-4077-a9ff-8a3ba1fb88f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.460629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7b9167aa-a956-4077-a9ff-8a3ba1fb88f7 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:45.461878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7b9167aa-a956-4077-a9ff-8a3ba1fb88f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:45.477956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 391/769] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:45 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:45.494572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86587965-462c-4e59-9c4f-806ac47d26fe None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.506760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86587965-462c-4e59-9c4f-806ac47d26fe None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.511626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.512281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.512561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.512836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.513554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.515193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5676b00-1165-42a8-93bf-0d20cdd3c149 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.530320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 379/770] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:45 2022] POST /identity/v3/services => generated 269 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:45.567924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a093d-9902-4fe1-89b5-210550720790 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.568663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a093d-9902-4fe1-89b5-210550720790 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.569162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a093d-9902-4fe1-89b5-210550720790 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.571654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 392/771] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:45.579694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.580316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.580824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.600695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:45.602359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:45.622210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 380/772] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:45 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:45.648041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a093d-9902-4fe1-89b5-210550720790 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.661622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a093d-9902-4fe1-89b5-210550720790 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.666935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.668072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.668668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.669151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.682425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:45.690571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:49:45.692463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 393/773] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:45.699200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.708283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66237-e3b9-4920-aba0-1d1e779dc365 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.713789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.715069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.715069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.715069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.715734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:45.716034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.717666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.727221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 381/774] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:45.733127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.743065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8acd-934c-49f4-935e-408ad6278717 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.748706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.749492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.749804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.750087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.762367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.764222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.780794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:45.782323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 394/775] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:45.788240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.798028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298287fb-6fa4-48fc-8e3f-1fcc43e4e519 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.802844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.803499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.803779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.804054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.804763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:45.805071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.807283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.825799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 382/776] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:45.827141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.839634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b18ad-048f-495f-b2f9-9e25681aa936 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.845069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.846355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.846846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.847366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.856377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.858818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.873395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:45.874946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 395/777] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:45.881385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.892312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2faaa2-fe58-4da0-ac5f-831fb890ab29 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.897139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.898009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.898482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.898915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.899960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:45.900425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.902573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.925902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 383/778] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:45.928147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.938952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9ea67-3211-4412-97ca-69a35f8fdc56 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.943772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.944621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.945109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.945527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.954150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:45.956113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:45.968423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 396/779] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:45.972142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:45.982682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aae9-4cc2-4c7d-a64c-fd871b0977a1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:45.987433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:45.988418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:45.988889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:45.989303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:45.999926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.001998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.019413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:46.020719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 384/780] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:46.027693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:46.036655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98b0c-2333-4aef-adbb-96f51291ff3c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:46.041355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:46.042236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.042659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.043091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.043937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:46.044393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.046151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.062584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 397/781] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:46.065163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:46.075768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadea639-4545-498b-95eb-87f370b29e4a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:46.080694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:46.082397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.083205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.083625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.092096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.094278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.107735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:46.113834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 385/782] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:46.115934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:46.125772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e456a5-0824-4563-a515-7224be0fba5c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:46.130622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:46.131498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.131972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.132391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.133348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:46.133831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.136437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb06f4-bfdf-4e96-b920-ba4c39f646e0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.153830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 398/783] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:46.155943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:46.166502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58150f5-316b-491b-b5e7-9efb367956e8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:46.171133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:46.171949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.172375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.172788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.173771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] RBAC: Adding query filter params (role.id=7337a5e8975545dfa436e6ffe1a5b36d, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=ebc8afdc24134704b8c92eb749bca94d) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:46.174241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.176462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96c31-0e84-4ef3-a7a1-a0c45da7e521 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.185849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 386/784] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:46 2022] GET /identity/v3/role_assignments?user.id=ebc8afdc24134704b8c92eb749bca94d&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=7337a5e8975545dfa436e6ffe1a5b36d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:46.878891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076aeb7-d254-4725-859d-18e327b4cd7b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.879429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076aeb7-d254-4725-859d-18e327b4cd7b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.879429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076aeb7-d254-4725-859d-18e327b4cd7b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.881534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 399/785] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:46.889509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378838e-2951-4c16-8d89-c6611ac62b17 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.889966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378838e-2951-4c16-8d89-c6611ac62b17 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.890203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378838e-2951-4c16-8d89-c6611ac62b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.908174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1378838e-2951-4c16-8d89-c6611ac62b17 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:46.909646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1378838e-2951-4c16-8d89-c6611ac62b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:46.918444 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 387/786] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:46 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:46.942059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076aeb7-d254-4725-859d-18e327b4cd7b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:46.954344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076aeb7-d254-4725-859d-18e327b4cd7b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:46.958862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:46.959526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:46.959810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:46.960090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:46.960817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:46.961918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:46.961918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:46.961918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:46.962836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ee55-e46e-4d1b-b9ff-e20918a96e45 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:46.978810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 400/787] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:46 2022] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:47.354577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf92eb-5181-42b4-8763-d2b0583906a6 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.354918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf92eb-5181-42b4-8763-d2b0583906a6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.355137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf92eb-5181-42b4-8763-d2b0583906a6 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.357231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 388/788] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:47.364978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.365267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.365551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.386971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:47.388162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:47.406828 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 401/789] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:47 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:47.431638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf92eb-5181-42b4-8763-d2b0583906a6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:47.446446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf92eb-5181-42b4-8763-d2b0583906a6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:47.453340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:47.454370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.454678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.454965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.455568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:47.458231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:47.474585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:49:47.476127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 389/790] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:47.483345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:47.492337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6f873-8b1f-4c6d-a975-0f1e0a8ccd97 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:47.497475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:47.498158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.498442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.498718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.499415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:47.499721 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:47.501314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293a419-097b-4975-a274-f7a0d71a0ee3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:47.505915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 402/791] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:47.511988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:47.521889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f491ca-8a9e-426d-a5b4-338c42bd6ae8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:47.526549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:47.527250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.527530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.527807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.528502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:47.528807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:47.530465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef663d9-559f-4b9c-a161-9db87a8ad01a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:47.535127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 390/792] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:47.899109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8081-3082-4ff9-824d-891965e334d6 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.899817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8081-3082-4ff9-824d-891965e334d6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.899817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a8081-3082-4ff9-824d-891965e334d6 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.901689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 403/793] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:47.909354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.909908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.910075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.928425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:47.929933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:47.938690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 391/794] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:47 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:47.963415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8081-3082-4ff9-824d-891965e334d6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:47.976055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a8081-3082-4ff9-824d-891965e334d6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:47.980824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:47.981812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.982209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.982601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.983378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:47.985117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:47.998638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:49:48.000279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 404/795] 10.222.0.77 () {56 vars in 1153 bytes} [Fri Jan 28 01:49:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.006987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.016200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5053c-4fc0-4ca4-b390-7ada52b61d75 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.021083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.021771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.022081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.022362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.023094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.023404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.025564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.030689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 392/796] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.036875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.047520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97cf10-7eb4-4fb2-90fd-b2fe2bc57496 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.052475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.053135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.053420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.053698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.054453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.054762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.056443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.061686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 405/797] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.068151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.078390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f733d-7126-4fd5-85bd-90d22ceb0131 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.083092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.083777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.084062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.084342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.085156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] RBAC: Adding query filter params (interface=public, service_id=7d293a8ad59d40838bac480bcb2c1b21, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.085468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.087668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990f62-30dd-4307-87be-557c54946443 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.093649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 393/798] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/endpoints?service_id=7d293a8ad59d40838bac480bcb2c1b21&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.104130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.116730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a77cb-32b4-4bdc-9d10-32897fa7f1b4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.122817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.123870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.124182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.124605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.125989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.128301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94078970-7ee5-4d69-807c-d00a1be8c148 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.134897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 406/799] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:49:48.426904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9ab9-3a33-494d-b0a9-253be076a9a6 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.426904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9ab9-3a33-494d-b0a9-253be076a9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.426904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9ab9-3a33-494d-b0a9-253be076a9a6 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.427856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 394/800] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:48.436577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.436857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.437138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.455694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:48.457052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:48.465684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 407/801] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:48 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:48.488555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9ab9-3a33-494d-b0a9-253be076a9a6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.501451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9ab9-3a33-494d-b0a9-253be076a9a6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.506146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.507184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.507718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.508194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.519243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:48.527234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:49:48.533843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 395/802] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.535702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.544803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bc2e8-7b4d-4121-85ea-10931636ae5c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.549375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.550104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.550392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.550672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.551681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.551982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.553575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.562872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 408/803] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.569096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.580564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e850b77-1965-4525-9ad7-8a90847ccae0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.585427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.586526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.587102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.587619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.598656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.600757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.618254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:48.625518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 396/804] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.627120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.637856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e11bb9-5cb7-4c3e-aebb-8a41c64680c4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.642678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.643596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.644156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.644636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.645639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.646192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.648091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.665536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 409/805] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.667148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.677553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d21566-fe79-4373-b1ec-9d37499923f9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.683008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.684142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.684638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.685127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.692965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.695262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.710329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:48.718024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 397/806] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.720883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.733018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b06ad-411c-4397-b305-19254900690e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.738100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.739277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.739786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.740313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.741365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.742150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.744283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.768814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 410/807] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.770630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.785019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33bf5-9a3e-455a-8fcb-79f1d716ba90 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.789997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.791647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.792149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.792665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.804087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.806342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.823494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:48.829903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 398/808] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.831884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.842603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57978ed-9f70-4a0d-b09c-cf4b5d843217 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.847348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.848297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.848868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.849344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.850323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.850833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.852697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.869866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 411/809] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.871997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.882230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e80b33-1247-46a0-9058-9a206f8fd4c0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.887122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.888207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.888715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.889200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.896700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.898961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.913054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:48.920847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 399/810] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:48.922448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.933261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dbf63-24d7-4c29-9a9f-ab0b5ffe15a4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.938034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.938973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.939527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.940004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.941007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:48.941596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.943848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666525f-a09c-49ed-a0ac-bead1cc8b3f6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:48.961872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 412/811] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:48.965335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:48.976174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f339c3-a147-4fbc-b076-cdfdfef43482 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:48.981065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:48.982240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:48.982807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:48.983281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/ebc8afdc24134704b8c92eb749bca94d/roles/7337a5e8975545dfa436e6ffe1a5b36d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:48.985840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=ebc8afdc24134704b8c92eb749bca94d, role_id=7337a5e8975545dfa436e6ffe1a5b36d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:48.988856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a6f3c-4fed-4809-b171-cf4e9bc1d0e4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.009829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 400/812] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:48 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/ebc8afdc24134704b8c92eb749bca94d/roles/7337a5e8975545dfa436e6ffe1a5b36d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:49.239378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ac95-ee8d-4e08-bb1b-41674729f9a0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.239738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ac95-ee8d-4e08-bb1b-41674729f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.239939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ac95-ee8d-4e08-bb1b-41674729f9a0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.241992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 413/813] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:49.249487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.249796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.250079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.269458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:49.270985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:49.331408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 401/814] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:49 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:49.354187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ac95-ee8d-4e08-bb1b-41674729f9a0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.366710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ac95-ee8d-4e08-bb1b-41674729f9a0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.371686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.372481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.372762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.373037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.373681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.375501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.387659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:49:49.389274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 414/815] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:49.396180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.405739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5aad3-4b2d-4aca-bfc2-38b42322cc89 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.410710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.411387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.411666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.411937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.412640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:49.412941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.414650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.420119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 402/816] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:49.426539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.439354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c8a92-13ff-4c15-9e9a-2417bc2b6657 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.443900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.444614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.444895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.445171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.445941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:49.446252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.448610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.454103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 415/817] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:49.460537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.470284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512308-0014-4c99-9c23-fcb6a9af03ea admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.475098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.475858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.476139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.476415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.477249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] RBAC: Adding query filter params (interface=public, service_id=a936c8f48b334e08b6555738d3094b20, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:49.477557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.479289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cd568-a167-4b8d-acf1-bd380613fcbe admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.484913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 403/818] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/endpoints?service_id=a936c8f48b334e08b6555738d3094b20&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:49.491204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.501905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2491-e769-4734-b56c-61459fdfaa33 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.506616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.507331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.507669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.507946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.508625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.510940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4991c-a758-499e-ad47-db56cad1dc11 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.517390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 416/819] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:49:49.765833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a34c-d863-4ad2-9182-add6f2d5f05c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.766025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a34c-d863-4ad2-9182-add6f2d5f05c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.766296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2a34c-d863-4ad2-9182-add6f2d5f05c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.768173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 404/820] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:49.776423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2fbf-5d05-448c-ab6e-7d5476241bc4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.776711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2fbf-5d05-448c-ab6e-7d5476241bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.776990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2fbf-5d05-448c-ab6e-7d5476241bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.795046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-16bc2fbf-5d05-448c-ab6e-7d5476241bc4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:49.796233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-16bc2fbf-5d05-448c-ab6e-7d5476241bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:49.804569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 417/821] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:49 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:49.828217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2a34c-d863-4ad2-9182-add6f2d5f05c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.840939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2a34c-d863-4ad2-9182-add6f2d5f05c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.845490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.846377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.846830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.847252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.848118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.849909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219806c-2967-4d0c-b6f6-1bd24b0ff891 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.865422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 405/822] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:49 2022] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:50.451320 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282283-589b-4772-87c7-ef7f353c76bc None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.451829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282283-589b-4772-87c7-ef7f353c76bc None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.451905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24282283-589b-4772-87c7-ef7f353c76bc None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.453927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 418/823] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:50.461512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.461975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.462174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.479980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:50.481180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:50.497804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 406/824] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:50 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:50.523100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24282283-589b-4772-87c7-ef7f353c76bc None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:50.535270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24282283-589b-4772-87c7-ef7f353c76bc None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:50.539677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:50.541017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.541304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.541582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.542283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:50.543881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.555383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:49:50.557468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 419/825] 10.222.0.77 () {56 vars in 1153 bytes} [Fri Jan 28 01:49:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:50.564225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:50.573361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72d6b-adeb-4490-838b-03a184f5dd7e None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:50.578200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:50.578881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.579166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.579442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.580154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:50.580468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:50.582306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.588067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 407/826] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:50.594395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:50.604678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d9231-1731-4a99-afe8-ef41b288f91a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:50.609261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:50.609969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.610262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.610540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.611244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:50.611555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:50.613155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed988eb7-4b27-4e28-8247-84f2d9ab9ac3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.618984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 420/827] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:50.625201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:50.634908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3cd78-92d9-408f-bf6f-3cc437ff04e1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:50.639600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:50.640305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.640595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.640954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.641615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:50.642648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:50.642648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:49:50.642648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:49:50.643522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4511c1-7deb-420e-a908-4ced4c383109 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.666440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 408/828] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:51.272750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e277-502f-41f7-b3b2-56aa254ea8cf None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.273272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e277-502f-41f7-b3b2-56aa254ea8cf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.273770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e277-502f-41f7-b3b2-56aa254ea8cf None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.276759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 421/829] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:51.283909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.284200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.284481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.301966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:51.303140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:51.322272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 409/830] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:51 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:51.346009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e277-502f-41f7-b3b2-56aa254ea8cf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.358218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e277-502f-41f7-b3b2-56aa254ea8cf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.362607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.363405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.363684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.363957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.374898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:51.382028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:49:51.383472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 422/831] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:51.390415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.399279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb05e7-d5cb-4446-af9f-850b03148600 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.404429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.405096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.405377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.405654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.406426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.406732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.408424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.421237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 410/832] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:51.427253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.437063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73217-5c83-4351-af0c-184e7888a88f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.441697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.442520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.442796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.443071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.453936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.455751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.474829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:51.476301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 423/833] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:51.482517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.492295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae642b-b8fb-4d4d-8405-fdb8a09ab647 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.497052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.497810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.498096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.498421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.499193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.499555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.501195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.513970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 411/834] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:51.520116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.530804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3398bb-e9ce-4784-9978-b75c3ed9f166 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.535429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.536287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.536567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.536839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.544639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.546749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.562549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:49:51.564019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 424/835] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:51.570350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.580791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030455-5ddf-4d97-b71c-ad3fb8d785f4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.585533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.586219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.586549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.586826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.587742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.588048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.589959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.607823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 412/836] 10.222.0.77 () {56 vars in 1170 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:51.614204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.624741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91ab2-9117-4820-8dac-17039c6ad135 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.629507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.630193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.630518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.630790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.639363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.641158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.651931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 425/837] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:51.658496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.669412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d9f55-ac21-4946-a15c-b7a1b6457213 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.674608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.675432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.675769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.676046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.687890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.689732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.706739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:51.708203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 413/838] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:51.715073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.724276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3dc149-86bb-42d5-94e7-f8817c66c4cc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.729518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.730209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.730546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.730824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.731584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.731894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.733466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d297-8494-4361-9d2d-c96cefe32299 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.750057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 426/839] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:51.752100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.756563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ee15-3718-4a21-a2b1-f16b36c4ff06 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.756851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ee15-3718-4a21-a2b1-f16b36c4ff06 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.757134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ee15-3718-4a21-a2b1-f16b36c4ff06 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.759523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 427/840] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:51.763262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d1cc-c3ab-4dd3-9117-7d59c056d077 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.766704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.767058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.767343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.770312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.771289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.771569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.771836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.781455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.784294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.791474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:51.792984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:51.804802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 428/841] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:51 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:51.804980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:51.804980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 414/842] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:51.810232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.819958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c1dde-42a5-45fb-9e62-97527b41492c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.824570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.825230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.825511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.825806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.826588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.826895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.829026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.829484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.840957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2737d-b026-449e-af4c-040ea6b7071d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.842920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 429/843] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:51.846223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.847320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.847829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.848649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.849183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.849852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.851721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.859803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed687c-94b5-40a6-9579-a4a33ab5f526 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.864248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.864885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.865161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.865437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.866114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:49:51.866285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] RBAC: Adding query filter params (role.id=7337a5e8975545dfa436e6ffe1a5b36d, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=ebc8afdc24134704b8c92eb749bca94d) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.866595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.873447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.873797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 415/844] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:51.874740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 430/845] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/role_assignments?user.id=ebc8afdc24134704b8c92eb749bca94d&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=7337a5e8975545dfa436e6ffe1a5b36d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:51.875534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.886191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b3b83-b738-49c5-b692-c6f8256c1e5a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.891475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.892566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.893078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.893593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.894554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.895121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.897027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.909047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 416/846] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:51.910866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.922301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344dc9a-c2f4-40dd-9370-dc39985778e0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.928063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.929200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.929692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.930233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.931293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:51.931886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.933912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b30f2a-8110-4b64-accd-600b73c4db59 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.945487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 431/847] 10.222.0.77 () {56 vars in 1135 bytes} [Fri Jan 28 01:49:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:51.947788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:51.958373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e06a-9493-45b6-a884-69fcf5425276 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:51.964221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:51.965268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:51.965851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:51.966325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:51.967353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:51.969241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a09af2-f5a1-42ca-aad7-220263429206 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:51.998374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 417/848] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:52.165182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a38e-c444-4188-8e77-e597f312aef1 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.165480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a38e-c444-4188-8e77-e597f312aef1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.165675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a38e-c444-4188-8e77-e597f312aef1 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.167790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 432/849] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:52.177367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.177367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.177367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.195419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:52.197127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:52.214307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 418/850] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:52 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:52.237982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690a38e-c444-4188-8e77-e597f312aef1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.257005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690a38e-c444-4188-8e77-e597f312aef1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.262978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.264046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.264476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.264965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.265777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.267612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.281202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:49:52.282910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 433/851] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.293795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.298709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9282cc-47f8-4210-997c-6aee2b002b01 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.303815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.304596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.304977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.305350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.306959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.307374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.309109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.317853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 419/852] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.320879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.331152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59692dec-4daa-4b17-b9f0-93c90adca57d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.335705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.336363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.336645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.336919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.337641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.337985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.339632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.349868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 434/853] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.351799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.361514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339e4f2-baaa-49fb-9519-57e8560129f0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.366103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.366748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.367031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.367309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.368092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] RBAC: Adding query filter params (interface=public, service_id=35d007c3ec784107a3faf48855a3e114, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.368939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.370550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091560d6-3f92-4c53-827a-d0bd3117b890 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.380993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 420/854] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/endpoints?service_id=35d007c3ec784107a3faf48855a3e114&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.382336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.392598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642beab-abf4-45f7-a499-058ffa695682 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.397200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.397885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.398174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.398453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.399130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.400759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566e7-051b-4911-af6b-44b7f7e3d861 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.407100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 435/855] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:49:52.990096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b805b0-02f2-403f-8fd0-1f56a33a2521 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.991124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b805b0-02f2-403f-8fd0-1f56a33a2521 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.991621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b805b0-02f2-403f-8fd0-1f56a33a2521 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.993954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 421/856] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:53.001717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:53.002620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:53.003111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:53.021452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:53.022953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:53.031748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 436/857] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:53 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:53.055476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b805b0-02f2-403f-8fd0-1f56a33a2521 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:53.068772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b805b0-02f2-403f-8fd0-1f56a33a2521 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:53.074374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:53.075408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:53.075893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:53.076386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:53.077230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:53.079069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:53.090263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:49:53.092103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 422/858] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:53.099086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:53.109027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072b1f8-d20a-453a-9086-93ab108149a7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:53.114347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:53.115381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:53.115887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:53.116363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:53.117299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:53.117835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:53.120197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3fd43-81c6-4d1f-998d-d6cadf5aaff6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:53.125948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 437/859] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:53.132476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:53.143108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8f76f-0401-48ab-9e14-110c03927bf3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:53.147932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:53.148814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:53.149335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:53.149888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:53.150792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:53.151299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:53.153088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe6a9a-8d25-4216-9d2e-a0406f4d4a91 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:53.158532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 423/860] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:54.132544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff8ed-3c89-4a08-940a-75b0039ba682 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.133057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff8ed-3c89-4a08-940a-75b0039ba682 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.133132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff8ed-3c89-4a08-940a-75b0039ba682 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.135716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 438/861] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:54.143042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.143461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.143631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.161132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:54.162351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:54.171225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 424/862] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:54 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:54.195655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dff8ed-3c89-4a08-940a-75b0039ba682 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.208204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dff8ed-3c89-4a08-940a-75b0039ba682 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.212658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.213447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.213726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.214029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.214685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.216343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.227562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:49:54.229695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 439/863] 10.222.0.77 () {56 vars in 1126 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:54.237123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.247327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c40c77-5af7-4ec5-a321-c70386128507 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.252595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.253284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.253569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.253878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.254602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:54.254910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.256556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92579936-e7ec-45f0-8003-27efbe8bdf08 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.262498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 425/864] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:54.268865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.279347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce6b3c-664b-4742-8914-1d8479878472 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.284051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f211-322b-4130-8119-adce60620397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.284717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f211-322b-4130-8119-adce60620397 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.284999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f211-322b-4130-8119-adce60620397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.285279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f211-322b-4130-8119-adce60620397 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.286014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f211-322b-4130-8119-adce60620397 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:54.286326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f211-322b-4130-8119-adce60620397 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.287917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f211-322b-4130-8119-adce60620397 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.293621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 440/865] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:54.341695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cc8c-ec41-4d47-9526-82f9df8e39ac None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.342060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cc8c-ec41-4d47-9526-82f9df8e39ac None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.342292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4cc8c-ec41-4d47-9526-82f9df8e39ac None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.344510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 426/866] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:54.353347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.353662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.353951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.378435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:54.379663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:54.388157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 441/867] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:54 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:54.412876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4cc8c-ec41-4d47-9526-82f9df8e39ac None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.426713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4cc8c-ec41-4d47-9526-82f9df8e39ac None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.432009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.432687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.432968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.433242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.433997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.435867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.437261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.common [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:49:54.456582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.sql.core [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 28 01:49:54.456582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 28 01:49:54.456582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [parameters: {'id': '68c5cbaebcc94469945d134bf3844e58', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 28 01:49:54.456582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:49:54.471948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 68c5cbaebcc94469945d134bf3844e58.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 68c5cbaebcc94469945d134bf3844e58. Jan 28 01:49:54.473818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 427/868] 10.222.0.77 () {60 vars in 1161 bytes} [Fri Jan 28 01:49:54 2022] POST /identity/v3/projects => generated 262 bytes in 61 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:54.480713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.495467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367db8c-50d8-4158-a49a-f0a594c3a41b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.500165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.500962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.501240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.501562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.508723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.510888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.524287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8c4d0d17-f13d-4639-9faf-934958c6e1f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:54.526500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 442/869] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:54.533288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.547587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc715fc-1475-4c78-9c31-7072938d00dc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.552798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.553539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.553895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.554182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.554964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:54.555367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.557674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bc923-4c98-42ec-b264-1409ee1d827a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.579694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 428/870] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:54.627381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63e22-1617-4a52-a916-83052361f892 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.627693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63e22-1617-4a52-a916-83052361f892 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.627947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63e22-1617-4a52-a916-83052361f892 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.630015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 443/871] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:54.638006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.638584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.639009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.659475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:54.661308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:54.670832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 429/872] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:54 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:54.695550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63e22-1617-4a52-a916-83052361f892 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.709329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63e22-1617-4a52-a916-83052361f892 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.715077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.716171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.716717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.717182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.718018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.719900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.732375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:49:54.734289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 444/873] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:54.741561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.751735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9795e5-836b-492a-8b58-e443268dfcd1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.756782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.757663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.758135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.758557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.759959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:54.760415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.762272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.767667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 430/874] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:54.774530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.784419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71e69-1f87-42e5-a464-b7da186da12e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.789702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.790511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.790800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.791069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.791771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:54.792078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.793680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec98-e88e-430d-8a79-a178a0e41765 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.799243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 445/875] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:54.805668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:54.816735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b092-67ef-4300-8c2b-7307fbfa05e5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:54.822274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:54.823022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:54.823358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:54.823639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:54.824403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:54.826152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86282689-fd9b-44f9-8bc2-03c2593b8e82 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:54.845957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 431/876] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:49:55.404209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e952c8-4fee-4664-a2a7-4dc0fb1722d7 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.404715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e952c8-4fee-4664-a2a7-4dc0fb1722d7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.404789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e952c8-4fee-4664-a2a7-4dc0fb1722d7 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.406753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 446/877] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:55.414455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12090875-7b84-4a6c-9f0d-c4093161bf0a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.414906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12090875-7b84-4a6c-9f0d-c4093161bf0a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.414998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12090875-7b84-4a6c-9f0d-c4093161bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.435277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-12090875-7b84-4a6c-9f0d-c4093161bf0a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:55.436457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-12090875-7b84-4a6c-9f0d-c4093161bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:55.452882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 432/878] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 2480 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:55.476965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e952c8-4fee-4664-a2a7-4dc0fb1722d7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.489706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e952c8-4fee-4664-a2a7-4dc0fb1722d7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.494184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.494841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.495119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.495392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.496120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.497722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb1cc5-b97d-4cbb-9b7e-f4e5052eba43 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.513152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 447/879] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:56.544948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35384a2-4bef-42e5-89ff-157a9e3e5138 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.545436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35384a2-4bef-42e5-89ff-157a9e3e5138 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.545436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35384a2-4bef-42e5-89ff-157a9e3e5138 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.547670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 433/880] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:56.555637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f711-f43e-4089-8dd7-943aca095d61 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.556695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f711-f43e-4089-8dd7-943aca095d61 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.556780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f711-f43e-4089-8dd7-943aca095d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.575945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-02d7f711-f43e-4089-8dd7-943aca095d61 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:56.577134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-02d7f711-f43e-4089-8dd7-943aca095d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:56.594615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 448/881] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:56 2022] POST /identity/v3/auth/tokens => generated 2576 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:56.618836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35384a2-4bef-42e5-89ff-157a9e3e5138 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:56.631186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35384a2-4bef-42e5-89ff-157a9e3e5138 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:56.639848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:56.640786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.641299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.641810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.642742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:56.644557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e141e-9cb2-416a-a082-e27a511d9c20 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:56.659965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 434/882] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:49:56 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:49:56.981918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2f80-3703-4e7c-b945-3c7a0ac445da None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.982633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2f80-3703-4e7c-b945-3c7a0ac445da None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.983136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2f80-3703-4e7c-b945-3c7a0ac445da None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.985408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 449/883] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:56.992992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc9c-8ce3-4048-9879-2b96086cd1e2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.994133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc9c-8ce3-4048-9879-2b96086cd1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.994636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbc9c-8ce3-4048-9879-2b96086cd1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.013340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6e3fbc9c-8ce3-4048-9879-2b96086cd1e2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:57.014877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6e3fbc9c-8ce3-4048-9879-2b96086cd1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:57.032700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 435/884] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:56 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:57.033783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fb18-e749-48b0-9636-b9da2b72c56f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.033783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fb18-e749-48b0-9636-b9da2b72c56f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.033783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fb18-e749-48b0-9636-b9da2b72c56f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.037889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 450/885] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:57.043734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.044031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.044312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.061194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130fb18-e749-48b0-9636-b9da2b72c56f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.062879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:57.064351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:57.073784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 436/886] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:57 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:57.075582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130fb18-e749-48b0-9636-b9da2b72c56f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.080296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.081103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.081519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.081950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.082919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.084895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.086409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.common [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:49:57.097017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.099422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.sql.core [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 28 01:49:57.099422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 28 01:49:57.099422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [parameters: {'user_id': '2a27d2e41eab46ada41190862b60e39d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 28 01:49:57.099422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:49:57.106045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94970-3eef-41d1-a7ce-c52c8458a10a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.107596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 28 01:49:57.109242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 451/887] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:49:57 2022] POST /identity/v3/users => generated 160 bytes in 48 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:57.115863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.116100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.116902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.117179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.117452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.118133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.120228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.128310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c356952-8360-44ba-bbf9-284492504195 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.131764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:49:57.133022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.134480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.134714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.134997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.139386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 437/888] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:49:57.140603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.143118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.145447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.150664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f1b-1a25-4712-9df9-59e9f6f3ba6a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.155638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.156436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.156811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.157200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.158057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.158456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.160143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.160810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:49:57.162846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 452/889] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:57.169757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.172887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 438/890] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:57.175576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.185239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5978f-9f86-4f0a-b280-73be34120435 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.187109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f034-4b62-4149-af13-d8382432d44d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.192088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.192993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.193306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.193684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.193998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.194237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.194332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.194822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.195015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.195325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.196201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.197262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.197469 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.199758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1770d0-4f97-4bfd-b5fe-f14808fc782b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.208129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 439/891] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:57.210631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.221943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b2a3-ec99-4b88-bc04-cfc9b4932294 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.227063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.228008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.228487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.229057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.230086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] RBAC: Adding query filter params (interface=admin, service_id=35d007c3ec784107a3faf48855a3e114, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.231425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.233303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.245099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 440/892] 10.222.0.77 () {56 vars in 1270 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/endpoints?service_id=35d007c3ec784107a3faf48855a3e114&interface=admin®ion_id=RegionOne => generated 193 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:57.246876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.256597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efb3e-87d8-4ded-807f-4dfa659c60df admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.265773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 453/893] 10.222.0.77 () {56 vars in 1122 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:57.274479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.275773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.276062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.276342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.277094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.278966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d890c5d-ca2a-4efe-94e2-159fb415b601 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.287481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 441/894] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services => generated 1957 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:49:57.740013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b6d-abbe-4713-b0de-0adb4c21d16f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.740547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b6d-abbe-4713-b0de-0adb4c21d16f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.740624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd557b6d-abbe-4713-b0de-0adb4c21d16f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.742479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 454/895] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:57.750468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.750891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.751095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.769293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:57.770516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:57.778328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 442/896] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:57 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:57.801864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557b6d-abbe-4713-b0de-0adb4c21d16f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.815838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd557b6d-abbe-4713-b0de-0adb4c21d16f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.821126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.822853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.823375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.823898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.824941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.828112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.838981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:49:57.840294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 455/897] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:57.846835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.855834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eecac-df83-49b3-bf56-273788bbc022 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.860396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.861070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.861406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.861690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.862434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.862743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.864434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.870831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 443/898] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:57.877353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.887577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8dd2a-47b7-4ddd-83a1-be0999691e9d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.892575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.893300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.893619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.894023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.894728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.895040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.896726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.902670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 456/899] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:57.909062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.919287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bd23e-6c6b-49ff-a18c-fea6f0465b2f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.923790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.924527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.924887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.925237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.926132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] RBAC: Adding query filter params (interface=public, service_id=5c12f15134ad4f2188691262734e7e47, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:57.926769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.928429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617d56b-5aa9-49fe-ac51-bab73cee8e2f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.933519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 444/900] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/endpoints?service_id=5c12f15134ad4f2188691262734e7e47&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:57.939663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.949705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b398247-04c3-4d85-b66a-b958612c038d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.954132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.954782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.955064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.955340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.956010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.957573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae0d8-9025-4ee5-b759-54e64a6a4eca admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.964661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 457/901] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:49:58.965541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80fef1-5cea-4589-aefe-b07ef193c345 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.966146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80fef1-5cea-4589-aefe-b07ef193c345 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.966146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80fef1-5cea-4589-aefe-b07ef193c345 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.968156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 445/902] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:58.976002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.976453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.976694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.996993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:58.999091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:59.008431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 458/903] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:58 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:59.036060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80fef1-5cea-4589-aefe-b07ef193c345 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.048222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80fef1-5cea-4589-aefe-b07ef193c345 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.052829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.053630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.053947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.054228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] PATH_INFO: `/v3/services/image` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.054878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.057016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.067655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:49:59.068851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 446/904] 10.222.0.77 () {56 vars in 1126 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:59.076256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.085229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98952c-d964-4bd3-897a-31acedcee3da None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.089814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.090476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.090764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.091044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.091745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] RBAC: Adding query filter params (name=image) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:59.092054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.093674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.103470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 459/905] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:59.104853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.114484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414a19-d392-4fab-82b2-3085679c67aa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.119605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.120285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.120570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.120849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.121564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] RBAC: Adding query filter params (type=image) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:59.121910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.123535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.129258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 447/906] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:59.136348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.145989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6fa1-bf79-4d69-ab73-88e6e40a57fc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.150946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.151603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.151889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.152169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.152949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] RBAC: Adding query filter params (interface=public, service_id=b66940e4d0834b08bd4e6ffc7ade0fbe, region_id=RegionOne) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:59.153260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.154287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:49:59.154287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:49:59.154287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:49:59.155163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daef706-eb1b-460d-9f35-76dfebcce28f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.162701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 460/907] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/endpoints?service_id=b66940e4d0834b08bd4e6ffc7ade0fbe&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:59.169209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.179190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e03064-30c9-4938-8a5d-3b1ed749a63f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.183629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.184281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.184563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.184839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.185510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.187119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1648ce-9f94-4abe-86c7-1f8cea277b07 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.193784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 448/908] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:49:59.559926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912822-98f9-4e47-a621-c02eb1279dc5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.560158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912822-98f9-4e47-a621-c02eb1279dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.560405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a912822-98f9-4e47-a621-c02eb1279dc5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.562227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 461/909] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:59.569549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.569950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.570307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.587987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:59.589190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:59.597023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 449/910] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:59 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:59.621259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912822-98f9-4e47-a621-c02eb1279dc5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.633085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a912822-98f9-4e47-a621-c02eb1279dc5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.637404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.638226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.638516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.638796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.639443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.641025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.651955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:49:59.653228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 462/911] 10.222.0.77 () {56 vars in 1147 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:59.659732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.669157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827caaaf-6f0b-4549-ae30-ae88a8a16e9d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.673580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.674272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.674559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.674838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.675534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:59.675841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.677671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.683173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 450/912] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:59.689159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.699731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53600b-b191-4b63-9035-dd6a95c77ebf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.704215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.704916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.705209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.705489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.706212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:59.706525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.708128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8812980-5a90-48d7-aded-54ed983bcfe2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.712967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 463/913] 10.222.0.77 () {56 vars in 1143 bytes} [Fri Jan 28 01:49:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:59.719274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:59.729359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2fcdc-50dd-4a87-82a5-4b2052cc0a21 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:59.733966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:59.734676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:59.735036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:59.735386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:59.736194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:59.737890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dcb8b-c175-4599-b315-d5e3714c32eb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:59.752590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 451/914] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:49:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:00.139022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fac84-bd11-467b-9ce0-bf8c61de8828 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.139564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fac84-bd11-467b-9ce0-bf8c61de8828 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.139564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fac84-bd11-467b-9ce0-bf8c61de8828 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.141466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 464/915] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:00.148687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.149125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.149265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.167459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:00.168619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:00.184990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 452/916] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:00 2022] POST /identity/v3/auth/tokens => generated 2821 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:00.208235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fac84-bd11-467b-9ce0-bf8c61de8828 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:00.220665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fac84-bd11-467b-9ce0-bf8c61de8828 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:00.224974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:00.225829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.226085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.226356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.227024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:00.228680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:00.239310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:50:00.240605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 465/917] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:00.247386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:00.259452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f72bc6-fd74-44b1-9aad-2557da97ab51 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:00.263966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:00.264693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.265045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.265393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.268645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:00.268645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:00.268645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:00.273723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 453/918] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:50:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:00.280319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:00.289881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042e60-a54e-4823-9d56-056e518b5013 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:00.294361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:00.295009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.295293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.295566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.296250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:00.296556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:00.298147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126a49-b3e2-40b9-a5a9-95fe1f8f8b44 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:00.303209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 466/919] 10.222.0.77 () {56 vars in 1133 bytes} [Fri Jan 28 01:50:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:00.309378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:00.318844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c9110-0b2d-4c43-808c-be9f12aa1b75 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:00.323796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:00.324428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.324710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.324981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.325710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:00.327292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4b399-0f7a-4ff2-9571-4b5b31e4943e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:00.345696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 454/920] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:50:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:01.380283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f8b1-9791-4041-9341-63fe98170f74 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.380808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f8b1-9791-4041-9341-63fe98170f74 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.380808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f8b1-9791-4041-9341-63fe98170f74 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.382767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 467/921] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:01.389941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.390399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.390543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.408562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:01.409761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:01.428016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 455/922] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:01 2022] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:01.451195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038f8b1-9791-4041-9341-63fe98170f74 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.463712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038f8b1-9791-4041-9341-63fe98170f74 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.468046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.468834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.469116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.469393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] PATH_INFO: `/v3/services/image` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.470072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.471654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.483070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:50:01.484399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 468/923] 10.222.0.77 () {56 vars in 1126 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:01.490895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.501985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9db3-099b-4782-9f6c-a22003521c13 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.506510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.507174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.507462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.507740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.508452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.508808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.510495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.517045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 456/924] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:01.525072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.538632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da6f1d-fc4b-416f-99ec-7dec0d9d45cc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.545778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.546797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.547224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.547645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.548725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.549202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.552027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904b282-9ba1-4ce7-8147-2e47ad1aec07 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.559497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 469/925] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:01.566263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.579276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fc51-5ad1-4349-af33-a7be4ad5974c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.585722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.586437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.586777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.587542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.588317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.590572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4224-134d-4c36-8631-87aac7a46fc2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.613317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 457/926] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:50:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:50:01.949053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6eff-c723-4caa-95f7-3c7d85645916 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.949452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6eff-c723-4caa-95f7-3c7d85645916 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.949740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6eff-c723-4caa-95f7-3c7d85645916 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.951612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 470/927] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:01.958983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.959272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.959548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.976725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:01.978457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:01.995773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 458/928] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:01 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:02.020065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6eff-c723-4caa-95f7-3c7d85645916 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.032086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6eff-c723-4caa-95f7-3c7d85645916 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.038854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.039629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.039910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.040213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.041362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.043064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12d35-6bd4-47f3-b55d-1e02890342b4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.044779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 471/929] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:02.050914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.060600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7dcca-e2e7-4f33-9c0b-f6c3439a2aa8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.065002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.065646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.066003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.066276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.066981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.068863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed458e2-a7a1-494d-9f23-07d7c5f88a82 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.094586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 459/930] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:50:02 2022] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:02.592218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542d8ca-6c43-4c1a-8f58-d78a0531ea41 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.592713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542d8ca-6c43-4c1a-8f58-d78a0531ea41 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.592713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542d8ca-6c43-4c1a-8f58-d78a0531ea41 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.594497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 472/931] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:02.601503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.601925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.602143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.620976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:02.622182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:02.678008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 460/932] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:02 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:02.702259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542d8ca-6c43-4c1a-8f58-d78a0531ea41 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.714283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542d8ca-6c43-4c1a-8f58-d78a0531ea41 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.718634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.719552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.719905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.720248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.731017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:02.738162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:50:02.739493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 473/933] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:02.746696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.755490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40adab0-377a-4f64-9f55-ad20d8dd9709 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.760075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.760806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.761156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.761500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.762363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:02.762738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.764405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.774090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 461/934] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:02.779054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.789354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ea2a1-bcc2-4798-bf19-3685e257b80e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.794586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.795392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.795673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.795943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.807375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.809227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.826628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:02.828027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 474/935] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:02.834112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.844539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276dc8-1c6f-4916-9eba-ef6614c42a9f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.849025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.849794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.850150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.850496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.851272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:02.851646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.853935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.869784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 462/936] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:02.871757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.881346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ad75b-023f-443a-a2c8-ce61c4d0eb49 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.885787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.886571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.886851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.887135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.894403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.896407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.910305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:50:02.917378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 475/937] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:50:02.918891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.929150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33dcf4-4dd2-4fe9-b2d6-ecb5cfb99993 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.933721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.934475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.934829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.935177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.936070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:02.936446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.938407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:02.957209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 463/938] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:02.964147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:02.973774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8c310-f9bc-4dcd-969b-5a78c0b424a6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:02.978856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:02.979467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:02.979756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:02.980041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:02.987707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:02.989447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.003797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 476/939] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:02 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:03.005347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.015542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc2dc-578e-494a-9b87-c0331e49ed47 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.020015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.020858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.021208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.021557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.031438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.033264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.049874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:03.057076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 464/940] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:03.058329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.067018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be5735-fa33-42f0-971e-413dc9593053 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.071502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.072147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.072425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.072703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.073399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:03.073704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.075291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.086372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 477/941] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:03.092553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.101946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a831e2-5586-4785-823b-8f2be8e775d3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.106866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.107636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.107912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.108184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.114870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.116807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.129440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:03.130829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 465/942] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:03.136980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.146519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64be45e-0a34-40e2-9682-6f49b047c54f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.151518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.152246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.152614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.152959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.153934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:03.154203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.156114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dee3e8-5251-4768-a779-ceb0395a6171 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.173831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 478/943] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:03.175027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.185784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966113e-411d-4444-bbd6-d8cad0af259a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.190215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.190856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.191138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.191412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.192222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] RBAC: Adding query filter params (role.id=7337a5e8975545dfa436e6ffe1a5b36d, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:03.192532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.194401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3d75-0779-43cb-923c-ea5b3db95793 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.200659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 466/944] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=7337a5e8975545dfa436e6ffe1a5b36d => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:03.830916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a29f-60d3-4336-9f38-f28e6b96a657 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.831427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a29f-60d3-4336-9f38-f28e6b96a657 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.831535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a29f-60d3-4336-9f38-f28e6b96a657 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.833346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 479/945] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:03.840813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.841266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.841447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.858289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:03.859504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:03.867356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 467/946] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:03 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:03.892663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a29f-60d3-4336-9f38-f28e6b96a657 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.904835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a29f-60d3-4336-9f38-f28e6b96a657 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.909192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.909865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.910161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.910440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.918632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.920382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1dab-0a11-4f91-ae0b-fd9556324129 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.929687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 480/947] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:03.936639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.945570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5698eb-c0bc-40bd-8f87-56d1af5d77eb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.950136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.950922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.951210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.951490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.952661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.954387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e9415-0dd3-4b3e-b7ba-d139d861061a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.956111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 468/948] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:04.353474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea088-ed52-4e7b-9dfc-0ef5b642a9d7 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.353768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea088-ed52-4e7b-9dfc-0ef5b642a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.354068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea088-ed52-4e7b-9dfc-0ef5b642a9d7 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.355912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 481/949] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:04.363934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.364225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.364505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.381916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:04.383094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:04.390642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 469/950] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:04 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:04.416820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea088-ed52-4e7b-9dfc-0ef5b642a9d7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.428806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea088-ed52-4e7b-9dfc-0ef5b642a9d7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.433122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.433926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.434209 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.434484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.435626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.437288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd370e9-5e8d-4210-9767-6450cc698174 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.438885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 482/951] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:04.445126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.454035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd782823-92c7-40d4-a232-77507695a5f5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.458480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.459136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.459418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.459691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.460388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.462801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3569-92a7-4a6c-a06f-3ba424e0e4bf admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.486738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 470/952] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:50:04 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:05.356360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b54-4cff-4de6-b890-e5f2a784476f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.356859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b54-4cff-4de6-b890-e5f2a784476f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.356940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b54-4cff-4de6-b890-e5f2a784476f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.358723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 483/953] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:05.365989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.366430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.366544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.383773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:05.384944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:05.392448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 471/954] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:05 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:05.416336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45b54-4cff-4de6-b890-e5f2a784476f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.428610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45b54-4cff-4de6-b890-e5f2a784476f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.432943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.433734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.434041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.434319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.444063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:05.451757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:50:05.452894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 484/955] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:05.459353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.468671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce93d97-28ca-4b78-92dc-4eac2aba6ece None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.473125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.473797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.474206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.474481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.475222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:05.475526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.477106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.484744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 472/956] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:05.490778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.500776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3eda8-8178-480a-8872-2edad2abbb3b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.505276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.506058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.506344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.506621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.517059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.518886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.535369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:05.536449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 485/957] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:05.542806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.552418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4bf7-c7de-4c69-8cd2-74636cfe0401 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.556849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.557496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.557799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.558078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.558791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:05.559099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.560664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.572537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 473/958] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:05.578932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.589100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050964b0-377b-4131-a0b9-aa9a30b6d518 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.593506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.594312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.594593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.594868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.601930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.603914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.616956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:50:05.618092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 486/959] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:05.624291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.634299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf082ca-31a4-4cbd-b7ca-20d24c9f1601 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.638754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.639403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.639688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.639967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.640789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:05.641097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.642963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.660017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 474/960] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:05.666073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.675579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81738-15e2-43b5-982a-b48705f2bc40 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.680280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.681076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.681404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.681689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.692775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.694689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.714208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:05.715590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 487/961] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:50:05.721597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.731179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb996-5112-48de-bbd5-6c3f34b7f8b1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.735640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.736285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.736566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.736844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.737556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:05.737891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.739475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.750400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 475/962] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:05.756657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.766604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab73feb-99a0-48fd-b725-38ecee03d236 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.771032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.771797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.772076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.772440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.779656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.781564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.794023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:05.795102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 488/963] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:05.801955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.811974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395d72-c2b7-497d-8ff5-4fd48d0de9ec admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.816430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.817078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.817363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.817641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.818446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:05.818759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.820583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb79507-845d-4b71-b3e7-f4f9c2b3dcd2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.832066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 476/964] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:05.838803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:05.849535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a58560-dbdb-4f85-babe-564198b8431e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:05.854714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:05.855566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:05.855846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:05.856119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/7337a5e8975545dfa436e6ffe1a5b36d` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:05.858315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=77efb1f35bc948b1b218f0ae9deca0f9, role_id=7337a5e8975545dfa436e6ffe1a5b36d)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:05.861163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4e37-1b85-4c90-a2f6-5982403273e9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:05.874522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 489/965] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:05 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/77efb1f35bc948b1b218f0ae9deca0f9/roles/7337a5e8975545dfa436e6ffe1a5b36d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:50:06.706610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f1e8-a470-4b6f-b345-7fce9a68ef7d None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.707122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f1e8-a470-4b6f-b345-7fce9a68ef7d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.707206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234f1e8-a470-4b6f-b345-7fce9a68ef7d None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.708938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 477/966] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:06.716967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.717408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.717526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.734872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:06.736061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:06.789858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 490/967] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:06.814332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f1e8-a470-4b6f-b345-7fce9a68ef7d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.826371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234f1e8-a470-4b6f-b345-7fce9a68ef7d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.830749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.831522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.831807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.832084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.842629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:06.849416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:06.850624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 478/968] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:06.857814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.866522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ef67d-b969-4164-b462-7fb1251699e8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.870972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.871631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.871915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.872189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.872927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:06.873235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.874836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.882960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 491/969] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:06.889463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.899981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88e66-5e2f-48fd-86f5-069f645e35f0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.904463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.905305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.905590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.905907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] PATH_INFO: `/v3/users/b907b4b864ad49dfb34b49a3891b43c3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.919418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] RBAC: Authorizing `identity:get_user(user_id=b907b4b864ad49dfb34b49a3891b43c3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.921549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.923248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 479/970] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/users/b907b4b864ad49dfb34b49a3891b43c3 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:06.930033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.939495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6075-7d03-429f-a060-c5ff58f256f4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.943931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.944572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.944857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.945136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.953120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.954869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.964031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 492/971] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:06.970397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.979682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c320ba-0e48-41ae-80d7-6fcf4f83c100 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.984157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.984997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.985277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.985549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.986733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.988760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e65fd-504d-4995-a1f9-d5e7fda62768 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.990408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 480/972] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:06.996866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.005431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efad7-ddef-4a78-973a-cb6a40b1dca8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.010430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.011068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.011347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.011625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.012435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd, user.id=b907b4b864ad49dfb34b49a3891b43c3) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:07.012745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.014603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceece61-fc0c-4b79-a09b-756d3f315c27 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.020563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 493/973] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/role_assignments?user.id=b907b4b864ad49dfb34b49a3891b43c3&scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:08.048791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231bc6-ee8a-49e5-8acf-ed7b547ff132 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.049339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231bc6-ee8a-49e5-8acf-ed7b547ff132 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.049339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231bc6-ee8a-49e5-8acf-ed7b547ff132 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.051157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 481/974] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:08.059358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.059779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.059911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.077905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:08.079091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:08.086770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 494/975] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:08.110722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231bc6-ee8a-49e5-8acf-ed7b547ff132 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.123222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231bc6-ee8a-49e5-8acf-ed7b547ff132 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.127565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.128354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.128637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.128915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.139319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:08.146422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:50:08.147553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 482/976] 10.222.0.77 () {56 vars in 1141 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:08.154038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.162694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d46dee-1196-44df-a908-0b28492f95e5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.167487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.168138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.168417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.168688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.169425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.169729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.171325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.179516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 495/977] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:08.186189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.197591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9256a-7d70-4ce6-b37b-483782d3435d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.202445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.203315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.203602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.203888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.214574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.216410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.232611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:08.233817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 483/978] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:08.240098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.250305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321a5e-71c0-4af5-a5de-0f97560ffc6f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.254874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.255524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.255810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.256108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.256801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.257111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.259321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.271160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 496/979] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:08.277134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.286847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464597-06c9-46c0-8fb5-733cfb967a62 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.291637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.292415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.292704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.292983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.300180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.302435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.317394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:50:08.318585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 484/980] 10.222.0.77 () {56 vars in 1114 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:08.325379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.334948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e48f0-8ff1-401f-b2fe-95df0a5a9123 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.339334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.339986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.340268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.340542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.341354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.341659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.343521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.364549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 497/981] 10.222.0.77 () {56 vars in 1154 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:08.365651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.375562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44352-7d03-4d06-a990-c522cb6b5fa4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.380150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.380776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.381061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.381339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.389416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.391198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.399867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 485/982] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:08.405905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.415613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ddabb-19d1-48dd-9224-c4f344ab1eb2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.419982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.420750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.421032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.421307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.431947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.433731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.449456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:08.450602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 498/983] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:08.456436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.465315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1db6c-0a88-4054-8cbe-3424f65a5390 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.469855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.470493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.470779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.471057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.471760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.472068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.473624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.489969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 486/984] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:08.490856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.500832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a4090-ba79-43c2-b782-77dfce533b0c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.505382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.506187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.506476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.506759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.513396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.515338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.527881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:08.528995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 499/985] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:08.535217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.544886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817fafa-b59f-4d3c-93e0-72cef5f76188 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.549254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.549927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.550258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.550483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.551244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.551818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.553618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1079-ee5a-4012-963a-ce1fa4b61e5f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.565768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 487/986] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:08.572066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:08.582801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211118b-d29c-488a-af33-94f9de1317c9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:08.587481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:08.588135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:08.588424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:08.588705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:08.589589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] RBAC: Adding query filter params (role.id=7337a5e8975545dfa436e6ffe1a5b36d, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=77efb1f35bc948b1b218f0ae9deca0f9) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:08.589950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:08.591895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164f9a-8282-4fd8-a428-604a097c423d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:08.597716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 500/987] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:08 2022] GET /identity/v3/role_assignments?user.id=77efb1f35bc948b1b218f0ae9deca0f9&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=7337a5e8975545dfa436e6ffe1a5b36d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:09.211302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75017f-d8f6-4c57-b073-93b8b4e0da52 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.212358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75017f-d8f6-4c57-b073-93b8b4e0da52 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.212453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75017f-d8f6-4c57-b073-93b8b4e0da52 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.214341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 488/988] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:09.221693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.222248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.222351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.240240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:09.241422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:09.250958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 501/989] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:09.274370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75017f-d8f6-4c57-b073-93b8b4e0da52 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.286569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75017f-d8f6-4c57-b073-93b8b4e0da52 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.291447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.292320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.292600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.292872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.303084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:09.310531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:09.311716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 489/990] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:09.318443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.327599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8178-80ae-4d24-8f68-50276058e331 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.332253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.332918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.333201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.333478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.334260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:09.334569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.336154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.344487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 502/991] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:09.351299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.362854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43948fd9-4fc0-4fef-9836-d18d23c728fa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.367556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.369056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.369336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.369608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] PATH_INFO: `/v3/users/b907b4b864ad49dfb34b49a3891b43c3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.370894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] RBAC: Authorizing `identity:get_user(user_id=b907b4b864ad49dfb34b49a3891b43c3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.372994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.374601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 490/992] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/users/b907b4b864ad49dfb34b49a3891b43c3 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:09.381318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.391453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b018-3d20-4a84-99e7-3a729275fa08 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.396221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.397081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.397372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.397639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.398846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.400921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4130d-09c4-4860-bcee-1107b4f89c06 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.402666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 503/993] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:09.409411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.419696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436cffa-b417-48f1-b6ef-16c4cd529d78 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.424176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.425050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.425330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.425603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd/users/b907b4b864ad49dfb34b49a3891b43c3/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.427834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8cc86db8f54ccc83c6523bb48c82fd, user_id=b907b4b864ad49dfb34b49a3891b43c3, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.430602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2327e-3194-41ec-b1e4-a32eea4e84a3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.442928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 491/994] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:09 2022] PUT /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd/users/b907b4b864ad49dfb34b49a3891b43c3/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:50:11.542400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3b4b-eeff-4514-96cd-b68533899146 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.542992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3b4b-eeff-4514-96cd-b68533899146 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.542992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3b4b-eeff-4514-96cd-b68533899146 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.544615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 504/995] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:11.551457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.552115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.552276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.570019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:11.571224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:11.627743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 492/996] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:11.651572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3b4b-eeff-4514-96cd-b68533899146 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.663360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3b4b-eeff-4514-96cd-b68533899146 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.668275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.669062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.669348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.669627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.680083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:11.689877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:11.691019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 505/997] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:11.697263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.705986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017729-d22c-426b-865f-6755e7430bb6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.710499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.711149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.711435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.711745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.712583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:11.712898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:11.714528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:11.722533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 493/998] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:11.728839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.738625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae5336-74e6-49e2-90d7-66b8489f9cb4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.743703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.744534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.744814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.745088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] PATH_INFO: `/v3/users/b907b4b864ad49dfb34b49a3891b43c3` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.746296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b907b4b864ad49dfb34b49a3891b43c3)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:11.748385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:11.749943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 506/999] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/users/b907b4b864ad49dfb34b49a3891b43c3 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:11.755847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.764861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc676e0-5e87-4041-adfe-6626e78f037f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.769286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.769920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.770204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.770474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.779354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:11.781060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:11.789520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 494/1000] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:11.796245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.805671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b29ae-2e3e-46d1-a560-1a41876bd8d0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.810223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.811043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.811325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.811602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.812742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:11.814767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0c72f-2d5c-45db-bdb6-e8bad9e3df3a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:11.816363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 507/1001] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:11.822451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:11.830645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176727-2e49-41d9-9766-4ea180f394dd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:11.835101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:11.835712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.835996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.836271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.837583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd, user.id=b907b4b864ad49dfb34b49a3891b43c3) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:11.837927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:11.839695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582414e-6743-4c69-ac12-686ffc9185e8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:11.845206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 495/1002] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:11 2022] GET /identity/v3/role_assignments?user.id=b907b4b864ad49dfb34b49a3891b43c3&scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:14.044564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8da1a-22a7-4905-8eca-240c18a578c1 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.045086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8da1a-22a7-4905-8eca-240c18a578c1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.045195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8da1a-22a7-4905-8eca-240c18a578c1 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.046916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 508/1003] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:14.054224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.054631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.054785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.071946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:14.073134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:14.080699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 496/1004] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:14 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:14.106378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8da1a-22a7-4905-8eca-240c18a578c1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.118126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8da1a-22a7-4905-8eca-240c18a578c1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.122434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.123202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.123484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.123759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.124899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.126612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c37e13-c679-4ce9-b73c-7f9d336c08c2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.128137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 509/1005] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:14.133828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.142463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c947b9-d0ea-4dfb-9097-764111d2ece1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.146889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.147534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.147817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.148096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.148788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.151220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447a2b8-3bc9-4ad5-bba4-097f5a1e8df2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.171244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 497/1006] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:50:14 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:16.358117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afef04-48fd-4245-a4f6-9fc867d6ead0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.358623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afef04-48fd-4245-a4f6-9fc867d6ead0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.358745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afef04-48fd-4245-a4f6-9fc867d6ead0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.360417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 510/1007] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:16.367359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.367752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.367931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.384922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:16.386118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:16.393514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 498/1008] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:16.418083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afef04-48fd-4245-a4f6-9fc867d6ead0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.430112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afef04-48fd-4245-a4f6-9fc867d6ead0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.434488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.435316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.435598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.435869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] PATH_INFO: `/v3/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.437314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] RBAC: Authorizing `identity:get_role(role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.438346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:50:16.438346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:50:16.438346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:50:16.439224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.440498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 511/1009] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/roles/ff066e890e8f45759e7037b2a84080ab => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.446201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.454599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4de220-8de4-42f5-a61d-a44151ce96e6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.458991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.459932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.460219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.460493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] PATH_INFO: `/v3/users/937704fcc8cd4bdb9973d69c6e772cd2` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.473539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] RBAC: Authorizing `identity:get_user(user_id=937704fcc8cd4bdb9973d69c6e772cd2)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.475672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.477259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 499/1010] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/users/937704fcc8cd4bdb9973d69c6e772cd2 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.483587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.492629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbe9f-c712-4649-a8f7-53e592dce7b5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.497036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.497675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.497988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.498266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.505651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.507365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.515862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 512/1011] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:16.521616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.530999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657b067-7596-478a-9810-284d91ee008a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.535383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611e067-3929-467a-a846-92b510232841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.536177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e067-3929-467a-a846-92b510232841 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.536457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e067-3929-467a-a846-92b510232841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.536734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e067-3929-467a-a846-92b510232841 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.537890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611e067-3929-467a-a846-92b510232841 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.540434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611e067-3929-467a-a846-92b510232841 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.542163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 500/1012] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.548132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.556554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fb1ba-41c3-4eb0-94c6-13b261a67514 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.560997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.561595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.561916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.562193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.562988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd, user.id=937704fcc8cd4bdb9973d69c6e772cd2) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:16.563321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.565103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350713a-4b38-45f9-af8a-72ebb4e3ec4b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.570215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 513/1013] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/role_assignments?user.id=937704fcc8cd4bdb9973d69c6e772cd2&scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd&role.id=ff066e890e8f45759e7037b2a84080ab => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:18.677591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda404f-b946-45bb-8340-7ba7b458f353 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.678152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda404f-b946-45bb-8340-7ba7b458f353 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.678152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda404f-b946-45bb-8340-7ba7b458f353 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.679923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 501/1014] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:18.687302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.687681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.687862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.704932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:18.706155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:18.714310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 514/1015] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:18.738930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda404f-b946-45bb-8340-7ba7b458f353 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.750711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda404f-b946-45bb-8340-7ba7b458f353 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.754988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.755809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.756088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.756361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] PATH_INFO: `/v3/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.757821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] RBAC: Authorizing `identity:get_role(role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.758817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:50:18.758817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:50:18.758817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:50:18.759685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.760967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 502/1016] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/roles/ff066e890e8f45759e7037b2a84080ab => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.766827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.776032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645621a0-931a-4559-84c9-7a0773a11bdb None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.780527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.781377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.781662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.782074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] PATH_INFO: `/v3/users/937704fcc8cd4bdb9973d69c6e772cd2` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.783306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] RBAC: Authorizing `identity:get_user(user_id=937704fcc8cd4bdb9973d69c6e772cd2)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.785634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.787227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 515/1017] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/users/937704fcc8cd4bdb9973d69c6e772cd2 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.793691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.803016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9ec2-f12e-4cd5-b373-d493d4fd0764 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.807409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.808203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.808482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.808755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.809914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.811884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696c19-87ee-4d49-8cc4-ecfc621aaeb5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.813442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 503/1018] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.819386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.828383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74ce0-2417-4d54-9c0b-b103d567f79e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.832760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.833596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.833912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.834190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd/users/937704fcc8cd4bdb9973d69c6e772cd2/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.836302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8cc86db8f54ccc83c6523bb48c82fd, user_id=937704fcc8cd4bdb9973d69c6e772cd2, role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.839374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7ebcc-727a-4d2b-a422-c2b6aeaa14d0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.851395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 516/1019] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:18 2022] PUT /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd/users/937704fcc8cd4bdb9973d69c6e772cd2/roles/ff066e890e8f45759e7037b2a84080ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:50:21.011565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c041dcb-56e1-4783-8a64-6261f2920926 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.012127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c041dcb-56e1-4783-8a64-6261f2920926 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.012127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c041dcb-56e1-4783-8a64-6261f2920926 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.013891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 504/1020] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:21.020856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.021278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.021417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.038326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:21.039482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:21.094225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 517/1021] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:21 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:21.118576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c041dcb-56e1-4783-8a64-6261f2920926 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.130384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c041dcb-56e1-4783-8a64-6261f2920926 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.135223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.136050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.136331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.136609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] PATH_INFO: `/v3/roles/ff066e890e8f45759e7037b2a84080ab` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.138072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] RBAC: Authorizing `identity:get_role(role_id=ff066e890e8f45759e7037b2a84080ab)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.139647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.140933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 505/1022] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/roles/ff066e890e8f45759e7037b2a84080ab => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.146699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.155098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31fdc2-e63e-4f0f-9f90-85e8506aa11f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.159480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.160321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.160603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.160879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] PATH_INFO: `/v3/users/937704fcc8cd4bdb9973d69c6e772cd2` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.162080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] RBAC: Authorizing `identity:get_user(user_id=937704fcc8cd4bdb9973d69c6e772cd2)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.164160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.166195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 518/1023] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/users/937704fcc8cd4bdb9973d69c6e772cd2 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.171901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.181802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257aad8-f1b8-4b7f-b71b-9310571239b5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.186226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.186812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.187097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.187374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.194830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.196482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.204973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 506/1024] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:21.210713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.219598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d6420-5205-45d9-9662-b2fda4723b09 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.223959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.224733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.225011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.225284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.226404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.228877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044b245-1382-41db-9b93-f746bacd7073 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.230466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 519/1025] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.236394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.245148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf660f-c97e-4181-8c50-ccbc624db364 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.249633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.250276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.250563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.250842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.251648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] RBAC: Adding query filter params (role.id=ff066e890e8f45759e7037b2a84080ab, scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd, user.id=937704fcc8cd4bdb9973d69c6e772cd2) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:21.251968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.253777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dc424-e8b8-4bf9-8af7-bdd29443e1c7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.259431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 507/1026] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/role_assignments?user.id=937704fcc8cd4bdb9973d69c6e772cd2&scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd&role.id=ff066e890e8f45759e7037b2a84080ab => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:23.440247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bd71d-81a4-46b3-a803-8c3846b7cacd None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.440800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bd71d-81a4-46b3-a803-8c3846b7cacd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.440800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bd71d-81a4-46b3-a803-8c3846b7cacd None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.442592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 520/1027] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:23.450215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.450655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.450770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.468363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:23.469529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:23.477039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 508/1028] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:23 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:23.500324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bd71d-81a4-46b3-a803-8c3846b7cacd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.512515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bd71d-81a4-46b3-a803-8c3846b7cacd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.516790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.517548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.517865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.518144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.519326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.521032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6140d2-f9a4-4478-bce9-13d13cbca6b5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.522557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 521/1029] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:23.529337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.537941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c413c-3300-4d3f-b41e-5895efa5c307 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.542315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.542941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.543222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.543495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.544192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.546078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e59b4-a2ef-4332-bfd3-57fe161940a2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.569984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 509/1030] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:50:23 2022] POST /identity/v3/projects => generated 311 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:25.735230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d89e-7971-4744-a052-9f596ffe5b7d None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:25.735737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d89e-7971-4744-a052-9f596ffe5b7d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:25.735851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d89e-7971-4744-a052-9f596ffe5b7d None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:25.737535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 522/1031] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:25.744944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:25.745437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:25.745781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:25.764244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:25.765411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:25.818646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 510/1032] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:25 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:25.844535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257d89e-7971-4744-a052-9f596ffe5b7d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:25.856286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257d89e-7971-4744-a052-9f596ffe5b7d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:25.860539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:25.861304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:25.861583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:25.861889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:25.863022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:25.864681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b931e-2398-40d5-bd3d-abe883fe3954 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:25.866229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 523/1033] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:25.872004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:25.880524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd6421-9aa7-4d6e-9a98-c64d93a1f2c6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:25.885362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:25.886030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:25.886310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:25.886583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:25.887282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:25.889157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c2175-2232-4d25-b30e-5bf041cc0428 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:25.908540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 511/1034] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:50:25 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:50:28.101498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae24db-8326-45e1-9c50-4f2d131661bc None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.102556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae24db-8326-45e1-9c50-4f2d131661bc None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.102671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae24db-8326-45e1-9c50-4f2d131661bc None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.104365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 524/1035] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:28.111339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.111730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.111897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.129564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:28.130757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:28.138180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 512/1036] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:28 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:28.161936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae24db-8326-45e1-9c50-4f2d131661bc None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.174159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae24db-8326-45e1-9c50-4f2d131661bc None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.178820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.179586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.179872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.180757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.190515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:28.197203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:28.198337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 525/1037] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:28.204545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.212928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715c942-c39e-45c9-818c-927a0a7c4930 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.217302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.217969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.218255 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.218529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.219254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:28.219560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.221156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.229687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 513/1038] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.238219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.248706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a984569-4e11-4167-88f3-b1b632be7200 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.253203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.254085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.254375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.254656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] PATH_INFO: `/v3/users/619109681ab54e599bb2d56ec70f6cd1` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.267274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] RBAC: Authorizing `identity:get_user(user_id=619109681ab54e599bb2d56ec70f6cd1)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.269462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.271223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 526/1039] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/users/619109681ab54e599bb2d56ec70f6cd1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.278091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.287542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4888078-bc4d-455b-852b-b26675bcfcbd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.292705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.293340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.293627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.293946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.301412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.303443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.312431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 514/1040] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:28.318707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.328005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311d041-1f1e-414d-8834-1abb15100f7a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.332466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.333297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.333585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.333907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] PATH_INFO: `/v3/projects/15f62fd3220f4178baab48102977b8ad` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.335062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] RBAC: Authorizing `identity:get_project(project_id=15f62fd3220f4178baab48102977b8ad)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.337568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784464f4-794b-4f58-bbc8-4ddbf972b17e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.339212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 527/1041] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/projects/15f62fd3220f4178baab48102977b8ad => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.345387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.354411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327dc9d-ef16-4dfe-9a34-120464310cb5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.358863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.359478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.359764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.360042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.360850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=15f62fd3220f4178baab48102977b8ad, user.id=619109681ab54e599bb2d56ec70f6cd1) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:28.361166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.362991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293bf1-77f9-409c-8401-73acf0eecb11 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.368576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 515/1042] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/role_assignments?user.id=619109681ab54e599bb2d56ec70f6cd1&scope.project.id=15f62fd3220f4178baab48102977b8ad&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:30.497148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3c81-e365-4433-b4ce-1c616b935130 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.497718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3c81-e365-4433-b4ce-1c616b935130 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.497718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d3c81-e365-4433-b4ce-1c616b935130 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.499483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 528/1043] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:30.506616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.507052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.507176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.525410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:30.526560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:30.534147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 516/1044] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:30 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:30.557975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d3c81-e365-4433-b4ce-1c616b935130 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:30.569737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d3c81-e365-4433-b4ce-1c616b935130 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:30.574654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:30.575415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.575701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.575979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.585855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:30.592552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:30.593676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 529/1045] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:30.599674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:30.608173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db7a50-e388-48c7-b5a7-0a81a70d3201 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:30.612582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:30.613219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.613502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.613813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.614542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:30.614849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:30.616463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:30.624769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 517/1046] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:30.630707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:30.640962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc02aa1-0cc3-443f-82c0-dc976428f118 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:30.645484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:30.646335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.646623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.646904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] PATH_INFO: `/v3/users/619109681ab54e599bb2d56ec70f6cd1` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.648080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=619109681ab54e599bb2d56ec70f6cd1)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:30.650243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:30.651776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 530/1047] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:30 2022] GET /identity/v3/users/619109681ab54e599bb2d56ec70f6cd1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:30.657377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:30.666258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464680c-7229-41ba-963a-e183cc09c431 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:30.670662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:30.671500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.671786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.672065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] PATH_INFO: `/v3/projects/15f62fd3220f4178baab48102977b8ad` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.673198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] RBAC: Authorizing `identity:get_project(project_id=15f62fd3220f4178baab48102977b8ad)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:30.675215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca053f0-8871-4dc0-b683-c8035d45afba admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:30.677169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 518/1048] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:30 2022] GET /identity/v3/projects/15f62fd3220f4178baab48102977b8ad => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:30.683291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:30.692350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e09c7-6550-4f40-a7ca-04120abbceb0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:30.697380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:30.698272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:30.698559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:30.698841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] PATH_INFO: `/v3/projects/15f62fd3220f4178baab48102977b8ad/users/619109681ab54e599bb2d56ec70f6cd1/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:30.700759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f62fd3220f4178baab48102977b8ad, user_id=619109681ab54e599bb2d56ec70f6cd1, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:30.703355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127afb6-aecd-4bf6-8774-4edd97d3d116 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:30.716165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 531/1049] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:30 2022] PUT /identity/v3/projects/15f62fd3220f4178baab48102977b8ad/users/619109681ab54e599bb2d56ec70f6cd1/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:50:32.856436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f442-ce46-43a9-ba1d-00b5b368c2ec None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:32.856983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f442-ce46-43a9-ba1d-00b5b368c2ec None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:32.856983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68f442-ce46-43a9-ba1d-00b5b368c2ec None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:32.858789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 519/1050] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:32.865833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:32.866276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:32.866382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:32.884414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:32.885576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:32.938284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 532/1051] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:32 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:32.962789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68f442-ce46-43a9-ba1d-00b5b368c2ec None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:32.974458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68f442-ce46-43a9-ba1d-00b5b368c2ec None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:32.979169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:32.979932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:32.980211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:32.980483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:32.990109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:32.997182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:32.998318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 520/1052] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:50:33.004484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:33.013963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a272-9ae8-4fcc-a73b-402f4c019775 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:33.018443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:33.019101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:33.019387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:33.019665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:33.020406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:33.020714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:33.022323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:33.030319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 533/1053] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:33.036378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:33.046299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff81c9-0537-48ab-8007-bc7138eb425f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:33.050747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:33.051576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:33.051858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:33.052387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] PATH_INFO: `/v3/users/619109681ab54e599bb2d56ec70f6cd1` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:33.053560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=619109681ab54e599bb2d56ec70f6cd1)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:33.056203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:33.057738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 521/1054] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:33 2022] GET /identity/v3/users/619109681ab54e599bb2d56ec70f6cd1 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:33.063526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:33.073000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea773d28-04db-440a-90a2-a6735e876c03 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:33.077340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:33.077975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:33.078256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:33.078529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:33.085884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:33.087584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:33.096003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 534/1055] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:33 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:50:33.101881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:33.111232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a5b4-825b-46b3-a38b-277afd0da1f5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:33.115642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:33.116458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:33.116737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:33.117009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] PATH_INFO: `/v3/projects/15f62fd3220f4178baab48102977b8ad` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:33.118628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] RBAC: Authorizing `identity:get_project(project_id=15f62fd3220f4178baab48102977b8ad)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:33.120628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb137b7f-6085-4cbe-b687-802bd96387bb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:33.122273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 522/1056] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:33 2022] GET /identity/v3/projects/15f62fd3220f4178baab48102977b8ad => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:33.128645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:33.137625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031a36-9b9f-4461-9c5a-7999d9b8f250 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:33.142037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:33.142652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:33.142933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:33.143210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:33.144008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=15f62fd3220f4178baab48102977b8ad, user.id=619109681ab54e599bb2d56ec70f6cd1) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:33.144316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:33.146127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b45bd9-3d8a-4da7-ac04-050faf80942c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:33.151604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 535/1057] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:33 2022] GET /identity/v3/role_assignments?user.id=619109681ab54e599bb2d56ec70f6cd1&scope.project.id=15f62fd3220f4178baab48102977b8ad&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:35.390414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2b4c-9551-405d-8fa5-a978a39a9cb5 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:35.390956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2b4c-9551-405d-8fa5-a978a39a9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:35.390956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2b4c-9551-405d-8fa5-a978a39a9cb5 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:35.392724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 523/1058] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:35.399716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:35.400092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:35.400272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:35.417693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:35.418890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:35.426411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 536/1059] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:35 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:35.457293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2b4c-9551-405d-8fa5-a978a39a9cb5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:35.472460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2b4c-9551-405d-8fa5-a978a39a9cb5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:35.478780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:35.479902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:35.480430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:35.480929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:35.489392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:35.491167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:35.500481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 524/1060] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:35 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:35.507783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:35.519130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382efef-8819-47fa-8457-e99364f3d44d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:35.523658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:35.524386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:35.524690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:35.524990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:35.531667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:35.533461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:35.547961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b4755085-5272-44cd-84e0-65a9ec6ace21 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 28 01:50:35.549103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 537/1061] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:50:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:35.556457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:35.565002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005d588-152f-4f71-aebc-104eb7a190d3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:35.569552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:35.570223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:35.570503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:35.570775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:35.571477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:35.571778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:35.573321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf6859-f04e-4287-a5cf-af7a66d34d88 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:35.580250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 525/1062] 10.222.0.77 () {56 vars in 1136 bytes} [Fri Jan 28 01:50:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:37.696162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f531f-0334-4dd4-9db6-df4d74736ce2 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:37.696667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f531f-0334-4dd4-9db6-df4d74736ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:37.696776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f531f-0334-4dd4-9db6-df4d74736ce2 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:37.698494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 538/1063] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:37.705863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517709f7-1ee1-4429-980f-dc6157d8440b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:37.706261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517709f7-1ee1-4429-980f-dc6157d8440b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:37.706424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517709f7-1ee1-4429-980f-dc6157d8440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:37.724096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-517709f7-1ee1-4429-980f-dc6157d8440b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:37.725285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-517709f7-1ee1-4429-980f-dc6157d8440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:37.733354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 526/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:37 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:37.757362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f531f-0334-4dd4-9db6-df4d74736ce2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:37.769188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f531f-0334-4dd4-9db6-df4d74736ce2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:37.773528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:37.774551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:37.775087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:37.775591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:37.776819 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:37.778323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:50:37.778323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:50:37.778323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:50:37.779850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0e535-81bb-4120-a46f-b51c41755274 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:37.795567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 539/1065] 10.222.0.77 () {60 vars in 1159 bytes} [Fri Jan 28 01:50:37 2022] POST /identity/v3/domains => generated 267 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:39.989588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87917d-0c99-40d9-a44c-516d6cef19be None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:39.990164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87917d-0c99-40d9-a44c-516d6cef19be None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:39.990164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87917d-0c99-40d9-a44c-516d6cef19be None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:39.991938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 527/1066] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:39.998882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:39.999295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:39.999429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:40.017079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:40.018293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:40.072062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 540/1067] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:39 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:40.096561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87917d-0c99-40d9-a44c-516d6cef19be None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:40.108397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87917d-0c99-40d9-a44c-516d6cef19be None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:40.112699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:40.113527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:40.113837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:40.114116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] PATH_INFO: `/v3/domains/8994ace221b54e8b912abb7055aad640` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:40.124260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8994ace221b54e8b912abb7055aad640)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:40.126264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28988d-c518-4e74-a55d-eec56535e37e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:40.127823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 528/1068] 10.222.0.77 () {56 vars in 1204 bytes} [Fri Jan 28 01:50:40 2022] GET /identity/v3/domains/8994ace221b54e8b912abb7055aad640 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:40.133873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:40.142788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551ad1-5ffd-4fb7-820c-3de71284bd0f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:40.147201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:40.147834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:40.148112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:40.148384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:40.149075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:40.151667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223979b-dea5-49bc-8822-344840de23a5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:40.175053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 541/1069] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:50:40 2022] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:42.349849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18a7d-89bc-40a6-b633-12546c5917c5 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.350360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18a7d-89bc-40a6-b633-12546c5917c5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.350479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18a7d-89bc-40a6-b633-12546c5917c5 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.352143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 529/1070] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:42.359834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.360255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.360395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.378131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:42.379315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:42.433608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 542/1071] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:42 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:42.458187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18a7d-89bc-40a6-b633-12546c5917c5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:42.469804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18a7d-89bc-40a6-b633-12546c5917c5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:42.474114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:42.474939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.475215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.475481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] PATH_INFO: `/v3/domains/8994ace221b54e8b912abb7055aad640` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.476625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8994ace221b54e8b912abb7055aad640)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:42.479055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab1972-e31b-489b-92eb-a73400895c52 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:42.480580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 530/1072] 10.222.0.77 () {56 vars in 1204 bytes} [Fri Jan 28 01:50:42 2022] GET /identity/v3/domains/8994ace221b54e8b912abb7055aad640 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:42.486425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:42.495517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e71d-0df1-4579-87b8-4f0c4c9330e6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:42.499952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:42.500595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.500885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.501164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.501893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:42.503758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505356d-041a-4cbe-bb7e-43d0242ae2e2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:42.522515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 543/1073] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:50:42 2022] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:50:44.686629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421881-b770-4f5f-927a-c5aeaf6bfcad None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.687148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421881-b770-4f5f-927a-c5aeaf6bfcad None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.687255 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421881-b770-4f5f-927a-c5aeaf6bfcad None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.688999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 531/1074] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:44.695900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.696270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.696486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.713430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:44.714636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:44.722054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 544/1075] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:44 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:44.746326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421881-b770-4f5f-927a-c5aeaf6bfcad None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.758146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421881-b770-4f5f-927a-c5aeaf6bfcad None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.762520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.763278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.763559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.763831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.774033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:44.781128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:44.782266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 532/1076] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:44.788273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.797292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c278c01-38c7-4d5d-8c4b-3380221599a6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.801640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.802573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.802853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.803125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.803850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:44.804153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.805718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.813487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 545/1077] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:44.819322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.828338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8cf1d-7948-402f-a021-bef4a61e9f3c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.832734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.833543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.833860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.834137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] PATH_INFO: `/v3/users/1cffade5c75c457a8cc330230cb983f4` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.847400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] RBAC: Authorizing `identity:get_user(user_id=1cffade5c75c457a8cc330230cb983f4)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.849495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.851121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 533/1078] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/users/1cffade5c75c457a8cc330230cb983f4 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:44.857717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.871787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ca01-5aec-4411-92e0-338a02576d65 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.877176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.877872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.878156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.878436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.886296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.888020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.898964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 546/1079] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:44.906035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.915884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e599-ce26-4816-8f62-2d9d759644db admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.920302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.921135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.921423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.921696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] PATH_INFO: `/v3/projects/57da054eb3c1492c81f5d746cbce70f4` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.922863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] RBAC: Authorizing `identity:get_project(project_id=57da054eb3c1492c81f5d746cbce70f4)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.924866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e6d9f-e51c-4368-8481-3344c1ccd55e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.926499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 534/1080] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/projects/57da054eb3c1492c81f5d746cbce70f4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:44.932803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.941191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41edbb6-a6b5-4723-94a2-661436c9a2cc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.946572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.947205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.947492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.947771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.948580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=57da054eb3c1492c81f5d746cbce70f4, user.id=1cffade5c75c457a8cc330230cb983f4) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:44.948892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.950725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc04b40-6fe1-4ea2-8e20-f5c9d9dad63d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.955967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 547/1081] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/role_assignments?user.id=1cffade5c75c457a8cc330230cb983f4&scope.project.id=57da054eb3c1492c81f5d746cbce70f4&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:47.081453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1aae-1e4d-41a6-a658-a0be5f9374a3 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.082024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1aae-1e4d-41a6-a658-a0be5f9374a3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.082117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1aae-1e4d-41a6-a658-a0be5f9374a3 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.083817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 535/1082] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:47.091410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.091789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.091954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.110131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:47.111292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:47.118750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 548/1083] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:47 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:47.141708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f1aae-1e4d-41a6-a658-a0be5f9374a3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.154215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f1aae-1e4d-41a6-a658-a0be5f9374a3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.158500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.159261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.159543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.159816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.170104 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:47.176660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:47.178106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 536/1084] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:47.184579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.193179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e163f4-3c42-4970-b1cd-3a06d541b47e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.197585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.198270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.198551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.198824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.199547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:47.199850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:47.201407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:47.209227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 549/1085] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:47.215995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.225839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530bec9-f741-43c5-ba81-cc5d95a39a0a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.230899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.231730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.232012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.232289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] PATH_INFO: `/v3/users/1cffade5c75c457a8cc330230cb983f4` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.233449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] RBAC: Authorizing `identity:get_user(user_id=1cffade5c75c457a8cc330230cb983f4)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:47.235594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:47.237132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 537/1086] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:47 2022] GET /identity/v3/users/1cffade5c75c457a8cc330230cb983f4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:47.242949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.252461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8510a9-8542-4cbe-8eda-33f1a3afa103 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.256812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.257635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.257940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.258213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] PATH_INFO: `/v3/projects/57da054eb3c1492c81f5d746cbce70f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.259985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] RBAC: Authorizing `identity:get_project(project_id=57da054eb3c1492c81f5d746cbce70f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:47.262012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d8269-9de1-4027-8409-3b8f2815cec4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:47.263609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 550/1087] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:47 2022] GET /identity/v3/projects/57da054eb3c1492c81f5d746cbce70f4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:47.269772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.279189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd48ad-05b7-49fc-9f53-8d82d15e9d7b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.283623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.284476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.284754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.285026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] PATH_INFO: `/v3/projects/57da054eb3c1492c81f5d746cbce70f4/users/1cffade5c75c457a8cc330230cb983f4/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.286913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57da054eb3c1492c81f5d746cbce70f4, user_id=1cffade5c75c457a8cc330230cb983f4, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:47.289464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc915-0202-4547-a609-dac1d999c848 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:47.301483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 538/1088] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:47 2022] PUT /identity/v3/projects/57da054eb3c1492c81f5d746cbce70f4/users/1cffade5c75c457a8cc330230cb983f4/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:50:49.424129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c2ed-4bd7-4635-bb87-55d6d239acd3 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.429100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c2ed-4bd7-4635-bb87-55d6d239acd3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.429100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c2ed-4bd7-4635-bb87-55d6d239acd3 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.429100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 551/1089] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:50:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:49.436165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.436594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.436711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.454261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:49.455422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:49.507822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 539/1090] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:49 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:49.532012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c2ed-4bd7-4635-bb87-55d6d239acd3 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.543784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c2ed-4bd7-4635-bb87-55d6d239acd3 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.548096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.548871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.549155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.549431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.560044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:49.566695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:49.567801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 552/1091] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:49.574374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.583022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597ab55-ec3f-4cf3-8a6c-4c6cae67e741 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.587642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.588297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.588576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.588849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.589585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:49.589952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.591506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.599644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 540/1092] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:49.606134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.616148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee343d-0805-400b-8335-dfb29c0d7671 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.621084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.621965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.622255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.622534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] PATH_INFO: `/v3/users/1cffade5c75c457a8cc330230cb983f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.623704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] RBAC: Authorizing `identity:get_user(user_id=1cffade5c75c457a8cc330230cb983f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.625849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.627415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 553/1093] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/users/1cffade5c75c457a8cc330230cb983f4 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:49.633443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.643262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1530-83d6-49d4-a385-cf013e589f60 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.647679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.648295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.648577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.648854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.656194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.657935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.666864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 541/1094] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:49.673088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.683236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eaff9-1e14-4e55-9462-c037e429192f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.687668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.688485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.688770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.689048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] PATH_INFO: `/v3/projects/57da054eb3c1492c81f5d746cbce70f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.690227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=57da054eb3c1492c81f5d746cbce70f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.692218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687854-8096-4e18-8662-8962e192b9b4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.693935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 554/1095] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/projects/57da054eb3c1492c81f5d746cbce70f4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:49.700526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.708709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393cd74-f901-460a-b9eb-3ace19b3c2a6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.713689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.714313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.714592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.714867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.715655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=57da054eb3c1492c81f5d746cbce70f4, user.id=1cffade5c75c457a8cc330230cb983f4) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:49.715964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.717714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d42b7b-4e60-4e01-9133-ac1c85bb8fb3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.723215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 542/1096] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/role_assignments?user.id=1cffade5c75c457a8cc330230cb983f4&scope.project.id=57da054eb3c1492c81f5d746cbce70f4&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:44.344783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bcf9-86b3-44c1-b662-3da521b566df None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.345408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bcf9-86b3-44c1-b662-3da521b566df None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.345408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443bcf9-86b3-44c1-b662-3da521b566df None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.347094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 555/1097] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:44.354882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.355361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.355464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.373632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:44.374971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:44.383643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 543/1098] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:44.410807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443bcf9-86b3-44c1-b662-3da521b566df None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:44.429904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443bcf9-86b3-44c1-b662-3da521b566df None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:44.436339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:44.437365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.442119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.442427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.454386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:44.456285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:44.479380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:44.480965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 556/1099] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:44.488582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:44.501028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876396-a441-42fb-a35a-0ae444ae27c4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:44.506856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:44.507510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.507787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.508067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.509409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:44.509717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:44.511356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251366d-24da-4ae1-80aa-88ae692ea5e8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:44.525001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 544/1100] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:44.531349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:44.541296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eb569-a679-4aba-8fca-02723639bdc9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:44.546074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:44.546732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.547014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.547295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.548045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:44.550001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1fd41-d939-463e-ad4f-60700d70c5ec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:44.572253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 557/1101] 10.222.0.77 () {60 vars in 1153 bytes} [Fri Jan 28 01:51:44 2022] POST /identity/v3/users => generated 251 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:51:47.215643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f314a6-457f-411f-9e86-3eb0ed2ba6d7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.216182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f314a6-457f-411f-9e86-3eb0ed2ba6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.216182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f314a6-457f-411f-9e86-3eb0ed2ba6d7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.218044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 545/1102] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:47.228403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.228893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.229126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.254719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:47.255915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:47.265133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 558/1103] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:47.291088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f314a6-457f-411f-9e86-3eb0ed2ba6d7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.307011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f314a6-457f-411f-9e86-3eb0ed2ba6d7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.312676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.313455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.313738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.314036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.330870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:51:47.341023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:51:47.348474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 546/1104] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:47.350792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.359842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a260d-578f-49fc-8d07-288a463c1fef None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.364381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.365046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.365423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.365606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.366357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.366688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.368777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.377376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 559/1105] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:47.383586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.393796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed894-d65b-483e-91b7-05d3bd75dac3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.398436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.399301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.399716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.400040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.410145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.411942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.429647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:47.431602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 547/1106] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:47.442482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.452233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25e88-9544-4404-aa2d-a361b46b00a3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.457213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.457980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.458361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.458664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.459480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.459838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.461476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.475140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 560/1107] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:47.482176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.492064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a81-957b-4ad9-89f7-94776985d7cb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.498292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.499116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.499400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.499675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.509001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.511075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.529225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:51:47.531285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 548/1108] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:47.538437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.549199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36795ec-92d8-4345-9eac-c03b5f1b62ed admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.554317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.555101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.555582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.556366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.557282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.557638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.559886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.581255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 561/1109] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:47.588801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.599758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d477-5438-4bbe-9e53-6ff62182e2b7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.605648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.606389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.606724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.607002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.616209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.618763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.633913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 549/1110] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:47.635888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.647854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6997717-1665-4361-a04c-2517cc96df7e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.654122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.655109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.655431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.655865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.669677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.671545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.693495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:47.700379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 562/1111] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:47.702086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.713680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6c68-c00c-45a3-9c9e-b03755ea7f1a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.719157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.719950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.720285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.720498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.721313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.721687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.723605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.741927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 550/1112] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:47.746153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.756572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d037d4d-636e-498a-ade4-b0c6d980b1ca admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.761531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.762358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.762639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.762912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.770291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.772262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.786764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:51:47.788340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 563/1113] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:47.799420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.812415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84606388-928c-4b80-aa2f-6df937463b49 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.819635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.820350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.820658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.821028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.822560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.822901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.825102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbe4ed-f404-472b-99d0-53234bdc260e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.840923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 551/1114] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:47.848264 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:47.860422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0dbf-b496-4a59-864e-614e8ba3ef9f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:47.865985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:47.866684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:47.866961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:47.867228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:47.868151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=5ba03c4dbf5c4232842c40b782e30021) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:47.868465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:47.870398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69da96-ffd2-4321-afdb-235ac7185928 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:47.876320 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 564/1115] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:51:47 2022] GET /identity/v3/role_assignments?user.id=5ba03c4dbf5c4232842c40b782e30021&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.362520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00db21-4dec-4b12-8791-ab08f3eea322 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.363103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00db21-4dec-4b12-8791-ab08f3eea322 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.363103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00db21-4dec-4b12-8791-ab08f3eea322 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.364827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 552/1116] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:50.372414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.372812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.372977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.390774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:50.391919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:50.399962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 565/1117] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:50 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:50.424196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00db21-4dec-4b12-8791-ab08f3eea322 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.438944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00db21-4dec-4b12-8791-ab08f3eea322 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.444209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.445118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.445405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.445685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.457465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:51:50.464323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:51:50.465504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 553/1118] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:50.472013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.481375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f4608-34fc-490c-8a29-be98eea1dba4 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.485944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.486603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.486889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.487170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.487921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:50.488227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.489852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.499406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 566/1119] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.506004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.517164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fa4-dbde-495a-9022-49172bef1c06 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.521722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.522474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.522759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.523036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.533665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.535797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.556219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:50.557428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 554/1120] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:50.564265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.574572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed699981-1b3c-420b-85ce-41bf91bc49ed admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.579338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.579997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.580280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.580571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.581290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:50.581603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.583233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.595078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 567/1121] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.601238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.611982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142f96-f223-496a-9682-51a225a86b0a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.616935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.617796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.618160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.618941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.627045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.629121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.644315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:51:50.645476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 555/1122] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:50.652453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.663042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32b96-5f01-4a53-bde1-d2342fb5faa0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.669040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.669704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.670018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.670305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.671134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:50.671447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.673291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.694039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 568/1123] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.700618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.710987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ad7f1-e3a9-417d-aafd-e2505fe89b4e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.716513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.717324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.717613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.717952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.729341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.731422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.750452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:50.751758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 556/1124] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:50.758326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.767876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff9d7-696d-4262-b20d-0389878e113a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.772712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.773322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.773608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.773937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.775142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:50.775455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.777050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.788884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 569/1125] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.795946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.807042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25638c94-8a1a-458e-9062-5541d302e5d4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.811745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.812524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.812808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.813095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.819688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.821666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.834384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:51:50.835981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 557/1126] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:50.843728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.856052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb112d1-41a1-4fff-92ac-b23e34407538 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.861280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.862107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.862451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.862769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.863729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:50.864099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.866520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2a391-d815-4592-b79b-03a672f505c0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.880516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 570/1127] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:50.887293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:50.898814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab7937-152e-410c-929d-e4262ae4c11e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:50.904733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:50.905611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:50.905926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:50.907430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/5ba03c4dbf5c4232842c40b782e30021/roles/b870e6b524a8493b90035a14e5acddcd` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:50.924057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=5ba03c4dbf5c4232842c40b782e30021, role_id=b870e6b524a8493b90035a14e5acddcd)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:50.927451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbee81-3225-47d9-90f2-1dab1c95b10c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:50.942163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 558/1128] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:51:50 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/5ba03c4dbf5c4232842c40b782e30021/roles/b870e6b524a8493b90035a14e5acddcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:51:53.231445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74662-6388-47d8-a907-e5780f291cf4 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.231998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74662-6388-47d8-a907-e5780f291cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.231998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74662-6388-47d8-a907-e5780f291cf4 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.233911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 571/1129] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:53.242280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.242758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.242909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.265574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:53.267237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:53.334646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 559/1130] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:53 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:51:53.368837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e74662-6388-47d8-a907-e5780f291cf4 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.381684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e74662-6388-47d8-a907-e5780f291cf4 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.386855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.387640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.387916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.388193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.398393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:51:53.405241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:51:53.406472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 572/1131] 10.222.0.77 () {56 vars in 1123 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:53.413309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.424928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded28b47-7af1-4eba-bf59-80896c84ccf2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.431381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.432048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.432334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.432756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.433626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.434064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.435991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.445206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 560/1132] 10.222.0.77 () {56 vars in 1124 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:53.452003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.463611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6e18-5e60-4c3d-81e7-303d0d75cfd1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.468469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.469249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.469531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.469826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.480607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.482569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.501503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:53.502716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 573/1133] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:53.509242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.519228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716efea-e4ca-4b99-84d5-5773b8927ca1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.524399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.525109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.525419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.525732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.526487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.526802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.528483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.541917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 561/1134] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:53.548318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.560577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11349c9-f9eb-433e-ac0e-53c190677048 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.565370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.566225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.566517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.566794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.574898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.576927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.591258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:51:53.592567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 574/1135] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:53.598712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.608718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383ef5a-917c-43e6-a28b-6415b0f53171 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.614163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.614163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.614574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.614863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.615691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.615998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.617848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.637806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 562/1136] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:53.644196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.654870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50424d87-87e8-40f1-aa81-86a572c4fee8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.660033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.660716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.661047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.661280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.670202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.672014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.682457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 575/1137] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:53.688838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.700264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd4fa-b776-4de4-8f4f-b9ebbc9aa45d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.704896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.705912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.706262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.706638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.719315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.721564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.741693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:53.743753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 563/1138] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:53.750170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.759500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e533f2-425b-4995-929f-61abf647a4a0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.764060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.764724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.765000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.765276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.766034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.766336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.767918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.779999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 576/1139] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:53.787370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.797856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c391b-5a51-49e3-a07a-6064b7b43d76 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.802653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.803433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.803718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.804232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.811011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.812994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.826412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:51:53.827774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 564/1140] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:53.835188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.845830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee10a3-77e9-4d07-9a18-df457e6469d0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.850675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.851375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.851777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.852055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.853644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.853984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.855814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ee43-d3e1-4783-a450-452300ec227c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.868814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 577/1141] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:53.875955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:53.886719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33320b4a-0bcf-4deb-b1c9-3613f5391959 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:53.891973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:53.892636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:53.892990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:53.893273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:53.894247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] RBAC: Adding query filter params (role.id=b870e6b524a8493b90035a14e5acddcd, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=5ba03c4dbf5c4232842c40b782e30021) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:53.894533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:53.896710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76490737-38c3-46c1-a151-047d316bb447 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:53.910549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 565/1142] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:51:53 2022] GET /identity/v3/role_assignments?user.id=5ba03c4dbf5c4232842c40b782e30021&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=b870e6b524a8493b90035a14e5acddcd => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:56.144232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4591-323c-494b-b0a8-cded2ed00698 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.144760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4591-323c-494b-b0a8-cded2ed00698 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.144760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab4591-323c-494b-b0a8-cded2ed00698 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.146563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 578/1143] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:56.154486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.154922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.155032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.172866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:56.174040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:56.182842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 566/1144] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:51:56.206920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4591-323c-494b-b0a8-cded2ed00698 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.221901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab4591-323c-494b-b0a8-cded2ed00698 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.226540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.227322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.228136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.228465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.239053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:51:56.245951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:51:56.247397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 579/1145] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:56.254221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.263298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea0918-cc06-4494-82cc-027a53eea825 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.268026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.268747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.268992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.269277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.270073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.270385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.271989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.281424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 567/1146] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:56.288172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.300224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cc15-ca88-4b55-90f0-0d4d6c988509 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.305009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.305855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.306142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.306421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.323230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.325964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.349027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:56.350692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 580/1147] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:56.358712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.372079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754f75-b1b6-4e18-a2b9-0dbb1ca22879 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.378051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.378926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.379355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.379656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.380657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.381106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.383320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.403461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 568/1148] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:56.404656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.415475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bae7fa-48d2-4c93-8aa1-50c3155239ca admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.421154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.422155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.422472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.422846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.431984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.434615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.450436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:51:56.451720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 581/1149] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:56.458857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.469720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96481c-2ad7-4753-ad44-738b6c42bae3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.474732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.475372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.475726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.475999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.476887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.477199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.479192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.497055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 569/1150] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:56.503753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.513878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb97b0-86fb-44d6-9efa-5d3581bfa3a5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.518328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.519059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.519375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.519715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.528522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.530457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.539270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 582/1151] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:51:56.545768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.556230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c30d7-2812-405a-ba91-144c04db5f2b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.561582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.562421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.562705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.563123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.575028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.577114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.596989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:56.598312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 570/1152] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:56.605255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.614052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343df8f-9213-4d07-a64b-5d19efccda72 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.618645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.619295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.619621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.619850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.620599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.620905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.622516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.635204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 583/1153] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:56.642774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.654214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f357c-9fb7-40aa-aa9b-4f5855b6c273 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.659273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.660211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.660483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.660790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.669019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.671240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.685898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:51:56.687197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 571/1154] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:56.693997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.704416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb4d9-2001-4b94-b798-eed9e5ece5d6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.709077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.709725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.710069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.710401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.711195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.711506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.714079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22fb6-12fe-4a1e-9fa8-dd670e8e8be2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.726371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 584/1155] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:56.732898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:56.744114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56204-4ff1-4324-906b-62ed0ddd7352 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:56.749261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:56.749943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:56.750225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:56.750498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:56.751309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=5ba03c4dbf5c4232842c40b782e30021) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:56.751616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:56.753541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a112-a576-46cc-a2c0-e5c46c1eeb7b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:56.760024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 572/1156] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:51:56 2022] GET /identity/v3/role_assignments?user.id=5ba03c4dbf5c4232842c40b782e30021&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:59.143403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8977f-a7bf-4c46-9575-8442bef524c1 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.144108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8977f-a7bf-4c46-9575-8442bef524c1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.144108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8977f-a7bf-4c46-9575-8442bef524c1 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.145814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 585/1157] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:59.155365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.155842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.156014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.173396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:59.174816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:59.183898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 573/1158] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:59 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:59.213477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8977f-a7bf-4c46-9575-8442bef524c1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.227657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8977f-a7bf-4c46-9575-8442bef524c1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.232981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.233971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.234266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.234549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.247986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:51:59.254904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:51:59.256116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 586/1159] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:59.264183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.274612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633b1a-dcc1-41dd-bdee-2c52a047924c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.280633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.281430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.281913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.282159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.282942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:59.283246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.285306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.294922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 574/1160] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:59.301977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.313176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918a88-5f21-45f9-ae0d-9eaffc740d92 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.318002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.318814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.319112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.319382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.331503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.333769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.352140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:59.353456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 587/1161] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:59.360588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.371654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb213f5-87ae-40e1-b27c-64597d4bcd55 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.379213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.380440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.381248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.382051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.383111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:59.384449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.387081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.403872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 575/1162] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:59.410984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.422956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b0a9-e68d-4569-89f0-14d1238a8ad6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.428127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.429002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.429508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.429862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.438550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.440751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.455206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:51:59.456469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 588/1163] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:51:59.463490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.473594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d79e-ca9e-4740-b529-2804d0ae8f8c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.479590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.480288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.480621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.480889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.481773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:59.482114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.483989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.502873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 576/1164] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:51:59.509492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.519689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ef9c7-2397-4d13-a308-1c8ddf63d40c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.524389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.525169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.525511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.525859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.537314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.539172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.557101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:51:59.558296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 589/1165] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:59.565327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.575999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1553c-5479-44a4-8d86-9f18ed87d073 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.580997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.581697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.582010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.582288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.583036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:59.583357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.585128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.597377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 577/1166] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:59.604411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.614390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc510d-7a8e-4710-a626-131dd1933870 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.619444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.620222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.620505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.620778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.628758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.631266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.646187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:51:59.647760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 590/1167] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:51:59.654715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.665474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a443c46-ad36-4404-bc7e-60d0ac02c31f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.670246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57297912-167a-4637-925f-9361108a8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.670890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297912-167a-4637-925f-9361108a8525 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.671184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297912-167a-4637-925f-9361108a8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.671505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57297912-167a-4637-925f-9361108a8525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.672282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297912-167a-4637-925f-9361108a8525 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:51:59.672588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297912-167a-4637-925f-9361108a8525 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.674583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57297912-167a-4637-925f-9361108a8525 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.687451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 578/1168] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:51:59.694626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:59.708939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe195feb-ddd0-4820-9bea-e9670af1fc3c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:59.715252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:59.716134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:59.716414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:59.716688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] PATH_INFO: `/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/5ba03c4dbf5c4232842c40b782e30021/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:59.719188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9328219c054e82ad31be25c0f28ade, user_id=5ba03c4dbf5c4232842c40b782e30021, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:59.721826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b9a7d-71a7-4251-b0f9-013790c20995 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:59.738533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 591/1169] 10.222.0.77 () {58 vars in 1460 bytes} [Fri Jan 28 01:51:59 2022] PUT /identity/v3/projects/6f9328219c054e82ad31be25c0f28ade/users/5ba03c4dbf5c4232842c40b782e30021/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:52:01.939337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecdaab-5cb6-4378-ae8a-de06e798b062 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:01.939972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecdaab-5cb6-4378-ae8a-de06e798b062 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:01.939972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecdaab-5cb6-4378-ae8a-de06e798b062 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:01.941644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 579/1170] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:52:01.949113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:01.949505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:01.949674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:01.967065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:52:01.968259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:52:02.022098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 592/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:52:02.046281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecdaab-5cb6-4378-ae8a-de06e798b062 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.058822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecdaab-5cb6-4378-ae8a-de06e798b062 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.063152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.063906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.064185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.064462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.074766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:52:02.081612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:52:02.082787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 580/1172] 10.222.0.77 () {56 vars in 1117 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:02.088693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.097207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aae9d-5f69-4181-aed4-4267ca3c4a8a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.101617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.102339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.102628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.102902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.103635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.103940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.105506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.114344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 593/1173] 10.222.0.77 () {56 vars in 1120 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:02.120408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.130362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fc6ad-38a5-4802-9786-6d9ccbea1eb9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.135398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.136145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.136433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.136710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.146590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.148407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.164285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:52:02.165417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 581/1174] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:02.171963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.182298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc087-dd91-40c7-b412-b037f34a8875 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.186718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.187358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.187637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.187912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.188613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.188919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.190625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.203306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 594/1175] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:52:02.209136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.218984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d58c-0725-4e0b-8578-449b01500377 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.223459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.224238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.224522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.224800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.232446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.234462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.248010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:52:02.249125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 582/1176] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:02.255278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.264643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02fb-67df-4784-be33-bced5fb2f261 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.269080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.269731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.270048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.270322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.271140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.271445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.273263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.290730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 595/1177] 10.222.0.77 () {56 vars in 1164 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:52:02.296765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.306416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdec80-0117-465b-8c46-896218e0e538 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.310873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.311497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.311780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.312059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.319996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.321850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.332730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 583/1178] 10.222.0.77 () {58 vars in 1324 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:52:02.340459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.351436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fede6-5067-4b07-a1b7-e7c15f5ac7d9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.357827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.358718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.358966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.359265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.371143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.373221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.392166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:52:02.393652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 596/1179] 10.222.0.77 () {56 vars in 1129 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:02.400616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.409322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152e8f-5656-443c-8b49-f65a3810443a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.413943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.414588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.415462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.415744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.416451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.416757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.418344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.429112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 584/1180] 10.222.0.77 () {56 vars in 1130 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:02.435084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.444420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234133a-9d0f-4214-a4bd-7cda9c80c4d4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.449316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.450103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.450384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.450665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.457154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.459085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.472014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING keystone.server.flask.application [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:52:02.473091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 597/1181] 10.222.0.77 () {56 vars in 1132 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:02.479249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.488566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9c5-4761-4507-a44c-9e78d54631dd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.493062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.493699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.494022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.494302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.495072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.495382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.497191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eedbc4-429a-444c-a8f2-1a9b58ffdcbf admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.509223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 585/1182] 10.222.0.77 () {56 vars in 1169 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:02.515564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:02.525949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1657b7f-4a2c-4601-bc20-7c7c8edd7841 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:02.530401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:02.531024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:02.531303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:02.531575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:02.532386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] RBAC: Adding query filter params (role.id=570ba9cb94054cda821730576cfb0f2e, scope.project.id=6f9328219c054e82ad31be25c0f28ade, user.id=5ba03c4dbf5c4232842c40b782e30021) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:02.532696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:02.534511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbaf73-0bd6-4ee8-951d-b9246daeee9e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:02.539911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 598/1183] 10.222.0.77 () {56 vars in 1395 bytes} [Fri Jan 28 01:52:02 2022] GET /identity/v3/role_assignments?user.id=5ba03c4dbf5c4232842c40b782e30021&scope.project.id=6f9328219c054e82ad31be25c0f28ade&role.id=570ba9cb94054cda821730576cfb0f2e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:04.702186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc1d9-6215-4824-bc98-3abc98df4880 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:04.702690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc1d9-6215-4824-bc98-3abc98df4880 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:04.702849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc1d9-6215-4824-bc98-3abc98df4880 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:04.704658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 586/1184] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:52:04.711750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:04.712177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:04.712301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:04.729593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:52:04.730820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:52:04.738529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 599/1185] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:52:04 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:52:04.761353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cc1d9-6215-4824-bc98-3abc98df4880 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:04.773221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cc1d9-6215-4824-bc98-3abc98df4880 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:04.777549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:04.778360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:04.778646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:04.778923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:04.779569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:04.781150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:04.792384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:52:04.793484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 587/1186] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:52:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:52:04.799846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:04.809375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4647-9729-4f50-8fd1-ba5700a0ec8e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:04.813915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:04.814559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:04.814844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:04.815124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:04.815815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:04.816125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:04.817694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f03d3-b1b8-488b-800d-894a5c64cbae admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:04.822435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 600/1187] 10.222.0.77 () {56 vars in 1137 bytes} [Fri Jan 28 01:52:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:04.828049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:04.837129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f588-24de-4ecc-ae4f-0ff7ac729e75 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:04.841695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:04.842346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:04.842632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:04.842912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] PATH_INFO: `/v3/services` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:04.843590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:04.843898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:04.845482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66901214-e73c-44a2-9915-aea7753408ca admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:04.849843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 588/1188] 10.222.0.77 () {56 vars in 1137 bytes} [Fri Jan 28 01:52:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:52:06.999790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bee0-37a3-4ec0-9f3a-e2eff23b4788 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:07.000336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bee0-37a3-4ec0-9f3a-e2eff23b4788 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:07.000336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bee0-37a3-4ec0-9f3a-e2eff23b4788 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:07.002138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 601/1189] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:52:07.009586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3bc9-d14b-473d-9bb8-d1ec2aa05b7c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:07.010016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3bc9-d14b-473d-9bb8-d1ec2aa05b7c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:07.010158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3bc9-d14b-473d-9bb8-d1ec2aa05b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:07.028030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-30eb3bc9-d14b-473d-9bb8-d1ec2aa05b7c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:52:07.029199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-30eb3bc9-d14b-473d-9bb8-d1ec2aa05b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:52:07.036702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 589/1190] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:52:07 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:52:07.059573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bee0-37a3-4ec0-9f3a-e2eff23b4788 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:07.071882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bee0-37a3-4ec0-9f3a-e2eff23b4788 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:07.076258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:07.076900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:07.077186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:07.077463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:07.078202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:07.079765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a2935-41fd-42d6-81a1-9816c0b95b6c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:07.092680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 602/1191] 10.222.0.77 () {60 vars in 1162 bytes} [Fri Jan 28 01:52:07 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:52:09.242036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9b8-8ae6-46bb-9143-99293701480f None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.242562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9b8-8ae6-46bb-9143-99293701480f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.242562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9b8-8ae6-46bb-9143-99293701480f None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.244333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 590/1192] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:52:09.251349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.251801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.251894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.268919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:52:09.270119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:52:09.286947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 603/1193] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:52:09.310793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda9b8-8ae6-46bb-9143-99293701480f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:09.323941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda9b8-8ae6-46bb-9143-99293701480f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:09.328781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:09.329566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.329913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.330238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.330906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:09.332476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:09.343816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:52:09.344936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 591/1194] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:52:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:09.351573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:09.360814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515fa25-fe68-40fa-a456-7547718a8fb0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:09.365278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:09.365958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.366238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.366512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.367200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:09.367505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:09.369092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:09.373982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 604/1195] 10.222.0.77 () {56 vars in 1137 bytes} [Fri Jan 28 01:52:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:09.380133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:09.389367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bee33-39d1-4521-a3f0-d110066b7487 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:09.393953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:09.394571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.394869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.395124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.395893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] RBAC: Adding query filter params (interface=public, service_id=a5f5ff28247044b69eaeb810ab3d3e5e, region_id=RegionOne) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:09.396202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:09.397765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0a25c-bee8-449f-bcaf-ebfa8a5091c5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:09.402991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 592/1196] 10.222.0.77 () {56 vars in 1272 bytes} [Fri Jan 28 01:52:09 2022] GET /identity/v3/endpoints?service_id=a5f5ff28247044b69eaeb810ab3d3e5e&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:52:09.408674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:09.418304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63e256-6982-4d41-821c-0e1c51f5e244 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:09.422759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:09.423375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:09.423654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:09.423927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:09.424572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:09.426121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3c438-726c-4737-a268-1ed5b38a89b6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:09.432859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 605/1197] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:52:09 2022] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:52:11.562815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe840-dccb-4db1-a8a0-ae0adad953fd None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:11.563319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe840-dccb-4db1-a8a0-ae0adad953fd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:11.563319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe840-dccb-4db1-a8a0-ae0adad953fd None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:11.565034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 593/1198] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:52:11.571904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:11.572298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:11.572452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:11.589921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:52:11.591089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:52:11.598542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 606/1199] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:52:11.623687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fe840-dccb-4db1-a8a0-ae0adad953fd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:11.636972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fe840-dccb-4db1-a8a0-ae0adad953fd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:11.641253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:11.642051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:11.642333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:11.642608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:11.643276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:11.644839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:11.655835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING keystone.server.flask.application [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:52:11.656919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 594/1200] 10.222.0.77 () {56 vars in 1138 bytes} [Fri Jan 28 01:52:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:52:11.663042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:11.672267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2657-495e-4a25-a83f-0dde09736db1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:11.676674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:11.677318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:11.677597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:11.677904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] PATH_INFO: `/v3/services` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:11.678596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:52:11.678902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:11.680731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca264-c01d-40b4-88d5-cb00cc09c45a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:11.685588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 607/1201] 10.222.0.77 () {56 vars in 1137 bytes} [Fri Jan 28 01:52:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:52:11.691281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:52:11.700699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666975-b3f1-47e4-b88f-91f244d1bab1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:52:11.705079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:52:11.705672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:52:11.705985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:52:11.706261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:52:11.707052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:52:11.708561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e0fd3-0932-4ac2-a087-ab0826a75908 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:52:11.728270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 595/1202] 10.222.0.77 () {60 vars in 1165 bytes} [Fri Jan 28 01:52:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:53:14.763772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:14.764839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:14.765350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:14.775435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232aad-6036-4463-80c3-ba3c9a3e17a9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:14.776571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232aad-6036-4463-80c3-ba3c9a3e17a9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:14.777069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232aad-6036-4463-80c3-ba3c9a3e17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:14.780516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 608/1203] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:14.890839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-72232aad-6036-4463-80c3-ba3c9a3e17a9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:14.892489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-72232aad-6036-4463-80c3-ba3c9a3e17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:15.000813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 596/1204] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:15.038958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:15.044617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:15.303544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439e0fc-4b4a-42c2-889f-5b9a40f633f6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:15.406665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:15.407240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:15.407691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:15.408113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:15.408980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:15.410999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac0aa-5947-4619-909e-8b2ec119b9cc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:15.431799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 609/1205] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:53:15 2022] GET /identity/v3/projects => generated 2553 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:53:17.696815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc118-7426-4a50-893a-48cb1475ca3b None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:17.697362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc118-7426-4a50-893a-48cb1475ca3b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:17.697362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfc118-7426-4a50-893a-48cb1475ca3b None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:17.699179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 597/1206] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:17.706361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f51f8-b8a7-4cdb-86eb-87d51b5220a6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:17.706784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f51f8-b8a7-4cdb-86eb-87d51b5220a6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:17.706896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f51f8-b8a7-4cdb-86eb-87d51b5220a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:17.786858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0e7f51f8-b8a7-4cdb-86eb-87d51b5220a6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:17.788062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0e7f51f8-b8a7-4cdb-86eb-87d51b5220a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:17.879286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 610/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:17.929816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:17.930141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:17.930421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:17.932454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 598/1208] 10.222.0.77 () {54 vars in 963 bytes} [Fri Jan 28 01:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:17.938542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a390-faf5-4bfd-a43a-e0916697b65a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:17.938834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a390-faf5-4bfd-a43a-e0916697b65a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:17.939114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a390-faf5-4bfd-a43a-e0916697b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:18.010109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-63b5a390-faf5-4bfd-a43a-e0916697b65a None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:18.011226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-63b5a390-faf5-4bfd-a43a-e0916697b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:18.082732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 611/1209] 10.222.0.77 () {58 vars in 1060 bytes} [Fri Jan 28 01:53:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:53:18.092422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:18.094029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:18.191905 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83213bb4-e092-4bc4-8bde-fbc88f213595 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:18.267913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:18.268482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:18.268766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:18.269909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:18.271732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:18.382092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:18.384191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc2cb-803d-4f3c-9177-d00f3382bcd6 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:18.401425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 599/1210] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:53:20.823882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:20.824405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:20.824405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:20.826168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 612/1211] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:20.833050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923b77-a25e-42a7-b77b-ae9c1556051e None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:20.833441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923b77-a25e-42a7-b77b-ae9c1556051e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:20.833606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923b77-a25e-42a7-b77b-ae9c1556051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:20.894557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1e923b77-a25e-42a7-b77b-ae9c1556051e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:20.895747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1e923b77-a25e-42a7-b77b-ae9c1556051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:20.987928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 600/1212] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:21.026432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:21.027930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:21.126741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c7ab5-c057-474e-8361-290190453ab7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:21.193814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:21.194450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:21.194729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:21.195004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:21.196585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:21.297515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:21.298950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa32807-353b-49aa-9f23-948fbb9cc960 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:21.316617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 613/1213] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:23.765801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:23.766330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:23.766423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:23.768134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 601/1214] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:23.775720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3730-9c18-4513-8ddd-6a1ecaa9ef66 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:23.776089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3730-9c18-4513-8ddd-6a1ecaa9ef66 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:23.776316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3730-9c18-4513-8ddd-6a1ecaa9ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:23.841926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a57a3730-9c18-4513-8ddd-6a1ecaa9ef66 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:23.843124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a57a3730-9c18-4513-8ddd-6a1ecaa9ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:23.932399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 614/1215] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:23.967263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:23.968754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:24.082431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a21f2-b59b-40af-8e8a-5f48186b8839 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:24.173723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:24.174628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:24.174915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:24.175183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:24.184840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:24.186942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810032f-9c3a-4c16-ae94-5fdbda0cdd1d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:24.188607 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 602/1216] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:53:23 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:53:24.218034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:24.218319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:24.218596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:24.220373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 615/1217] 10.222.0.77 () {54 vars in 963 bytes} [Fri Jan 28 01:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:24.226523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e48c9-0f47-4eea-a8d6-2b915d753725 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:24.226808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e48c9-0f47-4eea-a8d6-2b915d753725 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:24.227083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e48c9-0f47-4eea-a8d6-2b915d753725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:24.297519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f35e48c9-0f47-4eea-a8d6-2b915d753725 None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:24.298743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f35e48c9-0f47-4eea-a8d6-2b915d753725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:24.370231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 603/1218] 10.222.0.77 () {58 vars in 1060 bytes} [Fri Jan 28 01:53:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:24.379391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:24.380914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:24.484938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfc3f9-122a-4617-a5f1-ebb359fe9513 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:24.555504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:24.556149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:24.556691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:24.557234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:24.558895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:24.659493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:24.660837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c05eb-f1e3-448e-b7c0-21b5a98edce6 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:24.678453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 616/1219] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:24 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:27.773236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:27.773834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:27.773834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:27.775608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 604/1220] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:27.782732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:27.783143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:27.783292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:27.845157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:27.846363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:27.936543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 617/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:27.970588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:27.972086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:28.089706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3149a50-83c5-4d09-8c40-4bccc5cd615d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:28.176718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:28.177564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:28.177870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:28.178147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:28.187844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:28.189918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a8b19-7aa6-4917-90d2-24d18f09a1be admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:28.191580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 605/1222] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:53:27 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:53:28.203758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:28.204948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:28.292096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03eed0-b9b6-48d7-9ad1-26d2d55d9d07 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:28.362116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:28.362695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:28.362979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:28.363256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:28.364857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:28.466936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:28.468344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625c6fd-3d94-4a88-af11-b1f2be4ef75a service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:28.485084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 618/1223] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:31.350802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:31.351319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:31.351409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:31.353149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 606/1224] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:31.360258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82066-d536-4a17-bbe0-4e0097dbe395 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:31.360685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82066-d536-4a17-bbe0-4e0097dbe395 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:31.360825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82066-d536-4a17-bbe0-4e0097dbe395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:31.423753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b7d82066-d536-4a17-bbe0-4e0097dbe395 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:31.425110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b7d82066-d536-4a17-bbe0-4e0097dbe395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:31.516605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 619/1225] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:31.553934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:31.555495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:31.654374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d15688-8a1b-4f25-8ec0-8fb11fdc68f8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:31.723516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:31.724166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:31.724446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:31.724718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:31.726364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:31.831916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:31.833353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12be31-ac81-4c9d-92a8-9d9ca0cc6da4 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:31.850917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 607/1226] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:34.101811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:34.102392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:34.102392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:34.104126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 620/1227] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:34.111181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702106-af16-4eee-8224-21826c20cd91 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:34.111633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702106-af16-4eee-8224-21826c20cd91 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:34.111735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702106-af16-4eee-8224-21826c20cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:34.173737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b6702106-af16-4eee-8224-21826c20cd91 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:34.175109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b6702106-af16-4eee-8224-21826c20cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:34.270129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 608/1228] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:34.309680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:34.311222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:34.415217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23661a1-2b7f-4e1e-9b6d-b800e710a75c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:34.485837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:34.486490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:34.486775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:34.487051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:34.488669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:34.594075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:34.595508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079928c7-e64c-4032-aa4d-ee9486570dc8 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:34.614850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 621/1229] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:36.842252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:36.842765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:36.842765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:36.844491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 609/1230] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:36.851603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:36.852043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:36.852197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:36.913293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:36.914544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:37.008988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 622/1231] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:37.041293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:37.042861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:37.159760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973c0b7-9262-4637-8870-5925d439ab7f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:37.247731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:37.248587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:37.248890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:37.249171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:37.260337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:37.262450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbf4db-537f-413d-ba1d-18cd14ae6d4a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:37.265013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 610/1232] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:53:37 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:53:37.276888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:37.278113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:37.364822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da434-be84-4e0f-adfd-c647fff1c3a2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:37.440592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:37.441248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:37.441530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:37.441839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:37.443441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:37.553193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:37.554769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4425df-3ccb-47b0-8ea5-704eae5f8485 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:37.573987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 623/1233] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:40.030227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:40.030730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:40.030730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:40.032464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 611/1234] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:40.039650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88017e7-cd51-4588-87c7-432ce0c1d4d8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:40.040295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88017e7-cd51-4588-87c7-432ce0c1d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:40.040295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88017e7-cd51-4588-87c7-432ce0c1d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:40.103451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f88017e7-cd51-4588-87c7-432ce0c1d4d8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:40.104650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f88017e7-cd51-4588-87c7-432ce0c1d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:40.196988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 624/1235] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:40 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:53:40.233224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:40.234764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:40.337806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785c4ff-3b34-4627-aeb4-5819def25cd0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:40.408914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:40.409571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:40.409882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:40.410158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:40.411773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:40.515549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:40.516989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141b12-49c0-452d-92d2-d602265bfa28 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:40.534339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 612/1236] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:42.759204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:42.759731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:42.759731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:42.761560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 625/1237] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:42.768686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83225c6-7bf4-4ef0-921d-9252e4f14632 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:42.769058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83225c6-7bf4-4ef0-921d-9252e4f14632 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:42.769238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83225c6-7bf4-4ef0-921d-9252e4f14632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:42.831061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c83225c6-7bf4-4ef0-921d-9252e4f14632 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:42.832182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c83225c6-7bf4-4ef0-921d-9252e4f14632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:42.922873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 613/1238] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:42.964212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:42.965724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:43.086770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5661057-0ff7-41b8-b32b-f002258cfa01 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:43.154280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:43.154924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:43.155205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:43.155482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:43.157079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:43.257535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:43.259602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f6aad-b7ce-40e4-b05a-2bed9d9e536e service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:43.276697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 626/1239] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:45.809406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:45.810007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:45.810007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:45.811734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 614/1240] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:45.818621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129266bf-5256-46bf-979d-17845997add6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:45.819033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129266bf-5256-46bf-979d-17845997add6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:45.819189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129266bf-5256-46bf-979d-17845997add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:45.886526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-129266bf-5256-46bf-979d-17845997add6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:45.887719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-129266bf-5256-46bf-979d-17845997add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:45.986759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 627/1241] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:46.023468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:46.025718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:46.119729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac21877-2adb-4966-8d93-083a6cb525df None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:46.123194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:46.123837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:46.124122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:46.124403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:46.132927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:46.134923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fa1e0-89cd-411a-aa3e-83dc748b6aea service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:46.144144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 615/1242] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:50.192337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:50.192888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:50.192888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:50.194682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 628/1243] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:50.201826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56499-b4a3-4870-8f27-3fdcf8ae17a8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:50.202249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56499-b4a3-4870-8f27-3fdcf8ae17a8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:50.202451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56499-b4a3-4870-8f27-3fdcf8ae17a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:50.219689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c7a56499-b4a3-4870-8f27-3fdcf8ae17a8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:50.220862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c7a56499-b4a3-4870-8f27-3fdcf8ae17a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:50.229090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 616/1244] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:50.268259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:50.270068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:50.282516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a23a-4322-4188-bfb7-b9a80e5b026c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:50.286046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:50.286691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:50.286973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:50.287250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:50.296422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:50.297866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae2dae-eba3-4cc8-bec1-e3fbb64e051e service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:50.307870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 629/1245] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:53.199000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2987f-494c-46f1-b98e-07cbd997e13a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:53.199544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2987f-494c-46f1-b98e-07cbd997e13a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:53.199544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2987f-494c-46f1-b98e-07cbd997e13a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:53.201378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 617/1246] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:53.208942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286b5-296d-4314-b998-b6fc63c25fee None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:53.209347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286b5-296d-4314-b998-b6fc63c25fee None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:53.209499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286b5-296d-4314-b998-b6fc63c25fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:53.227279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e60286b5-296d-4314-b998-b6fc63c25fee None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:53.228441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e60286b5-296d-4314-b998-b6fc63c25fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:53.236109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 630/1247] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:53.278650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2987f-494c-46f1-b98e-07cbd997e13a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:53.289001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2987f-494c-46f1-b98e-07cbd997e13a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:53.292953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:53.293584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:53.293978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:53.294254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:53.302782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:53.304198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6d86-77ff-4406-b638-b20f06e405d2 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:53.314081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 618/1248] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:57.497902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c360ac-fc52-4c73-9d15-5572584359db None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:57.498494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c360ac-fc52-4c73-9d15-5572584359db None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:57.498494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c360ac-fc52-4c73-9d15-5572584359db None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:57.500244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 631/1249] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:57.508086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35681-4c41-4011-9c3b-824289c56946 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:57.508606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35681-4c41-4011-9c3b-824289c56946 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:57.508714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35681-4c41-4011-9c3b-824289c56946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:57.527412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-70d35681-4c41-4011-9c3b-824289c56946 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:57.528637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-70d35681-4c41-4011-9c3b-824289c56946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:57.536924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 619/1250] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:53:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:57.576294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c360ac-fc52-4c73-9d15-5572584359db None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:57.587546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c360ac-fc52-4c73-9d15-5572584359db None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:57.591197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:57.591838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:57.592127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:57.592405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:57.601947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:57.603366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffff30-b58c-4842-b0fc-a91a8d89b5a3 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:57.612772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 632/1251] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:02.719400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff3647-8980-4cc4-b967-d6ede9ccefea None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:02.720441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff3647-8980-4cc4-b967-d6ede9ccefea None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:02.720969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff3647-8980-4cc4-b967-d6ede9ccefea None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:02.723503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 620/1252] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 01:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:02.728909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9efc0b-f87c-458e-9114-f5776d10bbed None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:02.729789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9efc0b-f87c-458e-9114-f5776d10bbed None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:02.730274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9efc0b-f87c-458e-9114-f5776d10bbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:02.800087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6c9efc0b-f87c-458e-9114-f5776d10bbed None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:02.801624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6c9efc0b-f87c-458e-9114-f5776d10bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:02.882926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 633/1253] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:07.282143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57a5e-d385-4652-aa7e-a44898c1769c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:07.283019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57a5e-d385-4652-aa7e-a44898c1769c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:07.283313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57a5e-d385-4652-aa7e-a44898c1769c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:07.285377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 621/1254] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 01:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:07.290802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dac06-fed9-4775-b87e-77f10f6cb575 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:07.291253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dac06-fed9-4775-b87e-77f10f6cb575 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:07.291583 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dac06-fed9-4775-b87e-77f10f6cb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:07.310831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4c0dac06-fed9-4775-b87e-77f10f6cb575 None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:07.312158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4c0dac06-fed9-4775-b87e-77f10f6cb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:07.321294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 634/1255] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 01:54:07 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:08.789968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271655bc-a4c4-41a8-8c07-677639854856 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:08.790503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271655bc-a4c4-41a8-8c07-677639854856 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:08.790503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271655bc-a4c4-41a8-8c07-677639854856 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:08.792286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 622/1256] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 01:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:08.797466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41cc0-9db1-4eeb-9e59-918d243602d5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:08.797897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41cc0-9db1-4eeb-9e59-918d243602d5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:08.798070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41cc0-9db1-4eeb-9e59-918d243602d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:08.816855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-eff41cc0-9db1-4eeb-9e59-918d243602d5 None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:08.818053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-eff41cc0-9db1-4eeb-9e59-918d243602d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:08.827281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 635/1257] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 01:54:08 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:12.610660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d90d-7b40-4159-a86d-d4581225cadf None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:12.611200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d90d-7b40-4159-a86d-d4581225cadf None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:12.611200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d90d-7b40-4159-a86d-d4581225cadf None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:12.613256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 623/1258] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:12.621035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802ac5-41e8-4e46-9bbc-0e4c59b75b7e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:12.621473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802ac5-41e8-4e46-9bbc-0e4c59b75b7e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:12.621607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802ac5-41e8-4e46-9bbc-0e4c59b75b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:12.640839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a1802ac5-41e8-4e46-9bbc-0e4c59b75b7e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:12.642046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a1802ac5-41e8-4e46-9bbc-0e4c59b75b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:12.653514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 636/1259] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:12.702115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f204-5d76-4221-ba7e-1bab6b4e75db None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:12.702432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f204-5d76-4221-ba7e-1bab6b4e75db None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:12.702710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f204-5d76-4221-ba7e-1bab6b4e75db None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:12.704519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 624/1260] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 01:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:12.710253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57942-75ca-497c-996a-17fe0eae9a32 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:12.710549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57942-75ca-497c-996a-17fe0eae9a32 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:12.710832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc57942-75ca-497c-996a-17fe0eae9a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:12.758061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ddc57942-75ca-497c-996a-17fe0eae9a32 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:12.759236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ddc57942-75ca-497c-996a-17fe0eae9a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:12.842738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 637/1261] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:12.850678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82f204-5d76-4221-ba7e-1bab6b4e75db None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:12.866135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82f204-5d76-4221-ba7e-1bab6b4e75db None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:12.872521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:12.873317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:12.873762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:12.874285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:12.882983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:12.884735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d520c-84ec-4dee-a533-f0c42103fbc1 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:12.894338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 625/1262] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:54:15.314184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbd94-0c24-4264-80bf-e3ecd7556e02 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:15.315050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbd94-0c24-4264-80bf-e3ecd7556e02 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:15.315495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fbd94-0c24-4264-80bf-e3ecd7556e02 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:15.322150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 638/1263] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:15.324869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36d5-f239-4d65-a167-887af2fa70de None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:15.325296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36d5-f239-4d65-a167-887af2fa70de None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:15.325770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36d5-f239-4d65-a167-887af2fa70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:15.346414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8a1c36d5-f239-4d65-a167-887af2fa70de None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:15.348075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8a1c36d5-f239-4d65-a167-887af2fa70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:15.357788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 626/1264] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:15.405943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fbd94-0c24-4264-80bf-e3ecd7556e02 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:15.421038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fbd94-0c24-4264-80bf-e3ecd7556e02 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:15.426601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:15.427251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:15.427541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:15.427821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:15.436167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:15.437768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed5086-10ec-4df8-8a16-76409e171db3 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:15.447319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 639/1265] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:15 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:17.919165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665b96-4331-4ae7-ab7e-148a3a733a2b None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:17.920007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665b96-4331-4ae7-ab7e-148a3a733a2b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:17.920458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff665b96-4331-4ae7-ab7e-148a3a733a2b None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:17.922422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 627/1266] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:17.932758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b86a3-3951-4499-a76a-77ddb040fb4f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:17.933843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b86a3-3951-4499-a76a-77ddb040fb4f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:17.934268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b86a3-3951-4499-a76a-77ddb040fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:17.952874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-827b86a3-3951-4499-a76a-77ddb040fb4f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:17.954030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-827b86a3-3951-4499-a76a-77ddb040fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:17.961867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 640/1267] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:18.012075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac546-dc43-488b-92b2-2a6c72efab31 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:18.012363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac546-dc43-488b-92b2-2a6c72efab31 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:18.012647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac546-dc43-488b-92b2-2a6c72efab31 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:18.014516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 628/1268] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 01:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:18.020050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691bb31-3585-468d-9b6a-67feffa1b6fa None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:18.020403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691bb31-3585-468d-9b6a-67feffa1b6fa None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:18.020685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691bb31-3585-468d-9b6a-67feffa1b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:18.039862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5691bb31-3585-468d-9b6a-67feffa1b6fa None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:18.041023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5691bb31-3585-468d-9b6a-67feffa1b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:18.049945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 641/1269] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 01:54:18 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:18.058501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ac546-dc43-488b-92b2-2a6c72efab31 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:18.072624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ac546-dc43-488b-92b2-2a6c72efab31 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:18.078837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:18.079467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:18.079750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:18.080027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:18.087914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:18.089478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1686-7b76-4a6f-bccb-f8871a78ff0b service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:18.098419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 629/1270] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:54:20.339331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531217fb-a736-46a8-9396-ed6aeb5c2460 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.339849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531217fb-a736-46a8-9396-ed6aeb5c2460 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.340074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531217fb-a736-46a8-9396-ed6aeb5c2460 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.342242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 642/1271] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:20.349965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb6f-44b6-4cf8-92f6-8eb46f35aba0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.350414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb6f-44b6-4cf8-92f6-8eb46f35aba0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.350524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebdb6f-44b6-4cf8-92f6-8eb46f35aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.369537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-51ebdb6f-44b6-4cf8-92f6-8eb46f35aba0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:20.370769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-51ebdb6f-44b6-4cf8-92f6-8eb46f35aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:20.378907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 630/1272] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:20.424253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531217fb-a736-46a8-9396-ed6aeb5c2460 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:20.439623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531217fb-a736-46a8-9396-ed6aeb5c2460 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:20.445115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:20.445825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.446113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.446392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.455090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:20.456978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703ab6b-8a2e-46e5-a688-d6d5b11abfa7 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:20.467261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 643/1273] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:20.636904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b1a-8f2f-45b1-a146-8f72ee19c9dc None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.637190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b1a-8f2f-45b1-a146-8f72ee19c9dc None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.637668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b1a-8f2f-45b1-a146-8f72ee19c9dc None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.639525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 631/1274] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:20.647506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62f74-aa40-4bef-aa77-52e14e98a968 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.647794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62f74-aa40-4bef-aa77-52e14e98a968 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.648272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62f74-aa40-4bef-aa77-52e14e98a968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.672332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c9f62f74-aa40-4bef-aa77-52e14e98a968 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:20.673909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c9f62f74-aa40-4bef-aa77-52e14e98a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:20.682543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 644/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:20.736195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ce42-edb7-487e-b8f7-35cf01784acd None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.736480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ce42-edb7-487e-b8f7-35cf01784acd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.736944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ce42-edb7-487e-b8f7-35cf01784acd None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.738744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 632/1276] 10.222.0.77 () {54 vars in 962 bytes} [Fri Jan 28 01:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:20.744210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7268-3e3f-4b29-8f59-824901d077e7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.744605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7268-3e3f-4b29-8f59-824901d077e7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.745025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7268-3e3f-4b29-8f59-824901d077e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.811158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9d5b7268-3e3f-4b29-8f59-824901d077e7 None None] MFA Rules not processed for user `f0df50dd209d43f2b2b51267672145f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:20.812496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9d5b7268-3e3f-4b29-8f59-824901d077e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:20.873344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 645/1277] 10.222.0.77 () {58 vars in 1059 bytes} [Fri Jan 28 01:54:20 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:20.881910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ce42-edb7-487e-b8f7-35cf01784acd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:20.893861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ce42-edb7-487e-b8f7-35cf01784acd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:20.897705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:20.899166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:20.899620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:20.900052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:20.909768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:20.911350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54dd64-1afb-4c66-ab22-fe614ecbc29e service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:20.921294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 633/1278] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:22.694142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10aad-6d70-4ddb-a9c9-2ace3cb96d0c None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:22.694628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10aad-6d70-4ddb-a9c9-2ace3cb96d0c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:22.694718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10aad-6d70-4ddb-a9c9-2ace3cb96d0c None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:22.697291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 646/1279] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:22.704613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6942241-2771-4bf5-93da-c22ce643fdb3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:22.705067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6942241-2771-4bf5-93da-c22ce643fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:22.705174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6942241-2771-4bf5-93da-c22ce643fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:22.723528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c6942241-2771-4bf5-93da-c22ce643fdb3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:22.724733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c6942241-2771-4bf5-93da-c22ce643fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:22.732991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 634/1280] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:22.779287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10aad-6d70-4ddb-a9c9-2ace3cb96d0c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:22.793490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10aad-6d70-4ddb-a9c9-2ace3cb96d0c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:22.798953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:22.799605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:22.799886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:22.800165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:22.809493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:22.811103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0af8a-6616-499c-9f7c-8979051c2bd8 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:22.821219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 647/1281] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:25.051815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020806e-5364-4ca5-abbf-f7c9f6a87a02 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:25.052368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020806e-5364-4ca5-abbf-f7c9f6a87a02 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:25.052368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020806e-5364-4ca5-abbf-f7c9f6a87a02 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:25.054166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 635/1282] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:25.062063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43015abb-7190-4f0f-becb-d19d72a86c89 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:25.062467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43015abb-7190-4f0f-becb-d19d72a86c89 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:25.062632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43015abb-7190-4f0f-becb-d19d72a86c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:25.080839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-43015abb-7190-4f0f-becb-d19d72a86c89 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:25.082049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-43015abb-7190-4f0f-becb-d19d72a86c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:25.090329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 648/1283] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:25.148078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020806e-5364-4ca5-abbf-f7c9f6a87a02 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:25.162652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020806e-5364-4ca5-abbf-f7c9f6a87a02 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:25.168308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:25.169060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:25.169449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:25.169868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:25.178092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:25.180269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81192-8fcc-498a-bb35-38f096ecb0c8 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:25.193020 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 636/1284] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:27.414385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f57a-5c1c-4741-9b3c-5922c19cec47 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:27.414962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f57a-5c1c-4741-9b3c-5922c19cec47 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:27.414962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f57a-5c1c-4741-9b3c-5922c19cec47 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:27.416702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 649/1285] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:27.424083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456baaa-6ab9-43a0-b1eb-be29b6f54155 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:27.424507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456baaa-6ab9-43a0-b1eb-be29b6f54155 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:27.424634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456baaa-6ab9-43a0-b1eb-be29b6f54155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:27.442943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0456baaa-6ab9-43a0-b1eb-be29b6f54155 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:27.444127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0456baaa-6ab9-43a0-b1eb-be29b6f54155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:27.454730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 637/1286] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:27.500334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f57a-5c1c-4741-9b3c-5922c19cec47 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:27.515637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f57a-5c1c-4741-9b3c-5922c19cec47 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:27.521678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:27.522422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:27.522714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:27.522994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:27.532241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:27.533886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0f10-283a-4137-af8f-765c4e8497b3 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:27.544333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 650/1287] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:30.585824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d6ed-d871-4fdf-891c-04ab98c16b72 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:30.586334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d6ed-d871-4fdf-891c-04ab98c16b72 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:30.586854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3d6ed-d871-4fdf-891c-04ab98c16b72 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:30.590033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 638/1288] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:30.597518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc96d0-a1c1-4d51-9274-99461ecbd174 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:30.597985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc96d0-a1c1-4d51-9274-99461ecbd174 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:30.598124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc96d0-a1c1-4d51-9274-99461ecbd174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:30.616510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c8bc96d0-a1c1-4d51-9274-99461ecbd174 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:30.618412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c8bc96d0-a1c1-4d51-9274-99461ecbd174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:30.626300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 651/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:30.671131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d6ed-d871-4fdf-891c-04ab98c16b72 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:30.686581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3d6ed-d871-4fdf-891c-04ab98c16b72 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:30.692188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:30.692823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:30.693109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:30.693387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:30.701655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:30.703265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a0d47-db7b-4398-9cab-2bd5aa8ef70a service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:30.712507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 639/1290] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:33.575946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a59dd-5840-4a31-8dd0-8956de90a556 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:33.576448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a59dd-5840-4a31-8dd0-8956de90a556 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:33.576448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a59dd-5840-4a31-8dd0-8956de90a556 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:33.578327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 652/1291] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:33.585915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695183eb-d394-48f7-a94f-3139ca003ec8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:33.587135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695183eb-d394-48f7-a94f-3139ca003ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:33.587135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695183eb-d394-48f7-a94f-3139ca003ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:33.604955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-695183eb-d394-48f7-a94f-3139ca003ec8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:33.606186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-695183eb-d394-48f7-a94f-3139ca003ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:33.614094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 640/1292] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:33.659530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a59dd-5840-4a31-8dd0-8956de90a556 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:33.675004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a59dd-5840-4a31-8dd0-8956de90a556 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:33.681042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:33.681688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:33.682015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:33.682295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:33.690663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:33.692240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00f140-0288-4456-be06-40f1f134fa3d service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:33.701703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 653/1293] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:35.774778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d862-1ecd-43ef-a986-c6fe9242f064 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.775872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d862-1ecd-43ef-a986-c6fe9242f064 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.776382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772d862-1ecd-43ef-a986-c6fe9242f064 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.784398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 641/1294] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:35.787784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85738-47ca-4814-b2d5-498e662116b4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.787784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85738-47ca-4814-b2d5-498e662116b4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.787784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85738-47ca-4814-b2d5-498e662116b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.806901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-09e85738-47ca-4814-b2d5-498e662116b4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:35.808110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-09e85738-47ca-4814-b2d5-498e662116b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:35.817331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 654/1295] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:35.879280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7c1f-ed92-4e35-af89-003e1a3b94b7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.879573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7c1f-ed92-4e35-af89-003e1a3b94b7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.879859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7c1f-ed92-4e35-af89-003e1a3b94b7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.881898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 642/1296] 10.222.0.77 () {54 vars in 961 bytes} [Fri Jan 28 01:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:35.887758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.888053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.888341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.920220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02467ad-e75a-4bab-81b9-add2e74df11a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.920560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02467ad-e75a-4bab-81b9-add2e74df11a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.920815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02467ad-e75a-4bab-81b9-add2e74df11a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.922887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 643/1297] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:54:35.930438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:35.930733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:35.931012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:35.938910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] MFA Rules not processed for user `4799e6d178524148b5aea9a28ddc5145`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:35.940367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:35.951091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:35.952310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:35.961814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 644/1298] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:36.005704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:36.006409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 655/1299] 10.222.0.77 () {58 vars in 1058 bytes} [Fri Jan 28 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:36.014816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:36.018622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a30917-6c05-4ebc-8fbc-d23ab564f01c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:36.022067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4257d-90e1-4980-9e30-d41a412f8797 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:36.024734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:36.025428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.025679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.025967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.026284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:36.026912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.027193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.027472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.033894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:36.035508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902686-4348-4c7e-92f0-b498919f81e4 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:36.035954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:36.037354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b44f-357a-4363-8d9d-12ce430bfefb service glance] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:36.044540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 645/1300] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:54:36.048563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 656/1301] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:54:36.491226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40821-7832-431c-9706-0938cfd094ab None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.491589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40821-7832-431c-9706-0938cfd094ab None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.491942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f40821-7832-431c-9706-0938cfd094ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.538828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-64f40821-7832-431c-9706-0938cfd094ab None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:36.539974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-64f40821-7832-431c-9706-0938cfd094ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:36.602539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 646/1302] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 01:54:36 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:36.646573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9393-57f6-4603-8812-e22da24ee969 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.646866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9393-57f6-4603-8812-e22da24ee969 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.647151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9393-57f6-4603-8812-e22da24ee969 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.648989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 657/1303] 10.222.0.77 () {54 vars in 942 bytes} [Fri Jan 28 01:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:36.655424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f42f0d-bbff-4263-8b7f-01017e49a732 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.655703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f42f0d-bbff-4263-8b7f-01017e49a732 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.655979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f42f0d-bbff-4263-8b7f-01017e49a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.702852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-42f42f0d-bbff-4263-8b7f-01017e49a732 None None] MFA Rules not processed for user `d30381ee25fd43ea86c8a6cb53d384a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:36.704017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-42f42f0d-bbff-4263-8b7f-01017e49a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:36.771126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 647/1304] 10.222.0.77 () {58 vars in 1039 bytes} [Fri Jan 28 01:54:36 2022] POST /identity/v3/auth/tokens => generated 3447 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:36.781046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9393-57f6-4603-8812-e22da24ee969 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:36.797200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9393-57f6-4603-8812-e22da24ee969 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:36.802455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:36.803121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:36.803409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:36.803693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:36.813073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:36.814686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e573d7e-c0ad-4d8f-a23b-d4fa42debf0c service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:36.822686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 658/1305] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 01:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:54:38.270475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baa49-875c-4564-9839-b0d7f739a0ef None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:38.270987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baa49-875c-4564-9839-b0d7f739a0ef None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:38.271065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76baa49-875c-4564-9839-b0d7f739a0ef None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:38.273142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 648/1306] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:38.280795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6c62-82e4-43a3-b5b2-5ab40e84ba53 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:38.281218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6c62-82e4-43a3-b5b2-5ab40e84ba53 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:38.281383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6c62-82e4-43a3-b5b2-5ab40e84ba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:38.301569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c66e6c62-82e4-43a3-b5b2-5ab40e84ba53 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:38.302897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c66e6c62-82e4-43a3-b5b2-5ab40e84ba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:38.311522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 659/1307] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:38.358482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76baa49-875c-4564-9839-b0d7f739a0ef None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:38.373608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76baa49-875c-4564-9839-b0d7f739a0ef None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:38.379307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:38.379947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:38.380234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:38.380514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:38.392738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:38.394370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c3ba2-b896-4bb7-99bc-b302d7414a1f service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:38.405313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 649/1308] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:40.628982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4eb7-3a30-4b81-b4ab-77f77ed167a3 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.629936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4eb7-3a30-4b81-b4ab-77f77ed167a3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.630381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec4eb7-3a30-4b81-b4ab-77f77ed167a3 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.632307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 660/1309] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:40.640739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675295b-af97-4863-b9a7-f14c0f6815c1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.641229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675295b-af97-4863-b9a7-f14c0f6815c1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.641314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675295b-af97-4863-b9a7-f14c0f6815c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.659180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-7675295b-af97-4863-b9a7-f14c0f6815c1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:40.660357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7675295b-af97-4863-b9a7-f14c0f6815c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:40.669206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 650/1310] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:40.715226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec4eb7-3a30-4b81-b4ab-77f77ed167a3 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:40.730336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec4eb7-3a30-4b81-b4ab-77f77ed167a3 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:40.739337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:40.739337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.739692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.739889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.749533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:40.751159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0206a-6f3b-4435-b087-e59484f0ebe6 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:40.761727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 661/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:53.915364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a27-bc50-47de-8304-1acc68f4a2ad None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:53.915915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a27-bc50-47de-8304-1acc68f4a2ad None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:53.915915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711a27-bc50-47de-8304-1acc68f4a2ad None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:53.917695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 651/1312] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:53.924820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339f39-afb1-4052-ad5f-0ad083d01619 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:53.925210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339f39-afb1-4052-ad5f-0ad083d01619 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:53.925415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339f39-afb1-4052-ad5f-0ad083d01619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:53.944020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6d339f39-afb1-4052-ad5f-0ad083d01619 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:53.945219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6d339f39-afb1-4052-ad5f-0ad083d01619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:53.953500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 662/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:53.978090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711a27-bc50-47de-8304-1acc68f4a2ad None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:53.989915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f711a27-bc50-47de-8304-1acc68f4a2ad None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:53.994280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:53.994912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:53.995194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:53.995471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:53.996186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:53.998026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10ca20-f6c7-45c0-8764-f735e18a6902 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:54.016685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 652/1314] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:54:53 2022] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:54:56.115748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c972-187a-40a9-8fcc-6f8d2355470b None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:56.116308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c972-187a-40a9-8fcc-6f8d2355470b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:56.116308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c972-187a-40a9-8fcc-6f8d2355470b None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:56.118685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 663/1315] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:56.125715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:56.126198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:56.126299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:56.143891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:56.145090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:56.153295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 653/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:56.177466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c972-187a-40a9-8fcc-6f8d2355470b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:56.190610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c972-187a-40a9-8fcc-6f8d2355470b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:56.195006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:56.195875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:56.196154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:56.196428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] PATH_INFO: `/v3/projects/15f62fd3220f4178baab48102977b8ad` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:56.211200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f62fd3220f4178baab48102977b8ad)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:56.213802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:56.215580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 664/1317] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:54:56 2022] GET /identity/v3/projects/15f62fd3220f4178baab48102977b8ad => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:54:56.222380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:56.231821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df622f6-6048-4287-aef0-c0f24ab2d879 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:56.236580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:56.237226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:56.237509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:56.237817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:56.238625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] RBAC: Adding query filter params (scope.project.id=15f62fd3220f4178baab48102977b8ad) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:54:56.238930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:56.240756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a71aa-6797-43aa-b548-996f0cbb9004 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:56.247702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 654/1318] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:54:56 2022] GET /identity/v3/role_assignments?scope.project.id=15f62fd3220f4178baab48102977b8ad => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:54:56.253911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:56.263401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e646fc-43d0-4fdc-b5b8-33ef3ed41ef1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:56.267860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:56.268707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:56.268987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:56.269262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] PATH_INFO: `/v3/users/619109681ab54e599bb2d56ec70f6cd1` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:56.282176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] RBAC: Authorizing `identity:get_user(user_id=619109681ab54e599bb2d56ec70f6cd1)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:56.284275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f5265-fe06-4379-b5ef-59f4e9d14f6d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:56.285904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 665/1319] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:54:56 2022] GET /identity/v3/users/619109681ab54e599bb2d56ec70f6cd1 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:54:58.449830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae06-9f16-4caa-bc9f-dbf454f7543c None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:58.450350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae06-9f16-4caa-bc9f-dbf454f7543c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:58.450470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ae06-9f16-4caa-bc9f-dbf454f7543c None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:58.452159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 655/1320] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:58.459154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:58.459580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:58.459716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:58.477912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:58.479107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:58.486826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 666/1321] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:54:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:58.509865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ae06-9f16-4caa-bc9f-dbf454f7543c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:58.524680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ae06-9f16-4caa-bc9f-dbf454f7543c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:58.529296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:58.530179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:58.530466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:58.530744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] PATH_INFO: `/v3/projects/37e849972ffc41f284b0e49062648a7d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:58.542664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=37e849972ffc41f284b0e49062648a7d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:58.544720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:58.546445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 656/1322] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:54:58 2022] GET /identity/v3/projects/37e849972ffc41f284b0e49062648a7d => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:54:58.553117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:58.562605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2b10-cd71-4822-8b6f-30e61e9b3e0b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:58.567410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:58.568067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:58.568357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:58.568639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:58.569407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] RBAC: Adding query filter params (scope.project.id=37e849972ffc41f284b0e49062648a7d) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:54:58.569720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:58.571628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d07c6-1c6f-4564-a7fb-1f09393c55e8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:58.578081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 667/1323] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:54:58 2022] GET /identity/v3/role_assignments?scope.project.id=37e849972ffc41f284b0e49062648a7d => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:54:58.584326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:58.594330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58014aaa-76b5-4e63-a2e4-a214d6b0b6c6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:58.598955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:58.599816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:58.600102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:58.600382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:58.614726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:58.617169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6e40-0086-4431-939f-8f27f97b3e6f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:58.618874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 657/1324] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:54:58 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:00.921230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3443-58ce-4936-9999-40786949af8d None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:00.925380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3443-58ce-4936-9999-40786949af8d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:00.925380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa3443-58ce-4936-9999-40786949af8d None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:00.925380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 668/1325] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:00.932344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:00.932829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:00.932923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:00.953047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:00.954356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:00.963399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 658/1326] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:55:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:00.987760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa3443-58ce-4936-9999-40786949af8d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:01.000933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa3443-58ce-4936-9999-40786949af8d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:01.005314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:01.006201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:01.006498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:01.006780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] PATH_INFO: `/v3/projects/57da054eb3c1492c81f5d746cbce70f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:01.017654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=57da054eb3c1492c81f5d746cbce70f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:01.019729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:01.021408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 669/1327] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:55:00 2022] GET /identity/v3/projects/57da054eb3c1492c81f5d746cbce70f4 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:01.027944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:01.036769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189e5d-9bab-4fb0-96fe-8ece50cfacc2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:01.041786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:01.042414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:01.042696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:01.042969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:01.043721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] RBAC: Adding query filter params (scope.project.id=57da054eb3c1492c81f5d746cbce70f4) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:55:01.044022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:01.045866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c27020-6eaf-48aa-9ea4-f383351653d9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:01.051012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 659/1328] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:55:01 2022] GET /identity/v3/role_assignments?scope.project.id=57da054eb3c1492c81f5d746cbce70f4 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:01.057710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:01.067375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a196b8-1aeb-4fda-a31d-da5b7a1a48a3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:01.071909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:01.072747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:01.073031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:01.073304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] PATH_INFO: `/v3/users/1cffade5c75c457a8cc330230cb983f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:01.086110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] RBAC: Authorizing `identity:get_user(user_id=1cffade5c75c457a8cc330230cb983f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:01.088201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0532ff4-f7c0-4dbd-97be-4bd1646fdd46 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:01.089789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 670/1329] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:01 2022] GET /identity/v3/users/1cffade5c75c457a8cc330230cb983f4 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:55:03.276845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc63a-4837-4c72-b35a-3b41009d4faa None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:03.277324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc63a-4837-4c72-b35a-3b41009d4faa None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:03.277425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc63a-4837-4c72-b35a-3b41009d4faa None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:03.279291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 660/1330] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:03.286500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:03.286930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:03.287063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:03.304132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:03.305319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:03.313244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 671/1331] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:55:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:03.337558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc63a-4837-4c72-b35a-3b41009d4faa None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:03.349878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc63a-4837-4c72-b35a-3b41009d4faa None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:03.354263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:03.355093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:03.355374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:03.355653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] PATH_INFO: `/v3/projects/83aa2e6f27d34fe78a1b709f22247aec` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:03.356806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] RBAC: Authorizing `identity:get_project(project_id=83aa2e6f27d34fe78a1b709f22247aec)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:03.358623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:03.360243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 661/1332] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:55:03 2022] GET /identity/v3/projects/83aa2e6f27d34fe78a1b709f22247aec => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:03.366566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:03.375421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf0d5d-3a2a-4a89-abe3-c7ee924ea2ba None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:03.379937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:03.380579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:03.380865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:03.381146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:03.381956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] RBAC: Adding query filter params (scope.project.id=83aa2e6f27d34fe78a1b709f22247aec) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:55:03.382271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:03.384604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e200d3-506e-4a80-ab89-0462de9051a4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:03.390163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 672/1333] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:55:03 2022] GET /identity/v3/role_assignments?scope.project.id=83aa2e6f27d34fe78a1b709f22247aec => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:03.396082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:03.406075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a11f64-ad79-48d0-a96b-f22b178e4700 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:03.410587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:03.411414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:03.411694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:03.411971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:03.413122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:03.414938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59197e82-1cf6-404d-8b77-1f129a73b2b4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:03.416465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 662/1334] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:03 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:05.592773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db62c-18ef-409d-bbaf-59fea5a61ae7 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.593294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db62c-18ef-409d-bbaf-59fea5a61ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.593294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401db62c-18ef-409d-bbaf-59fea5a61ae7 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.595093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 673/1335] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:05.602203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.602597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.602762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.619932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:05.621118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:05.628750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 663/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:55:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:05.652864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401db62c-18ef-409d-bbaf-59fea5a61ae7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:05.664846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401db62c-18ef-409d-bbaf-59fea5a61ae7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:05.669179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:05.670052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.670335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.670608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] PATH_INFO: `/v3/projects/a6137b31db374b6ba2f413c885d90346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.681907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] RBAC: Authorizing `identity:get_project(project_id=a6137b31db374b6ba2f413c885d90346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:05.683959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:05.685931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 674/1337] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:55:05 2022] GET /identity/v3/projects/a6137b31db374b6ba2f413c885d90346 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:05.692265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:05.701601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313854eb-69aa-4f41-b412-e08f8e61a18d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:05.706143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:05.706779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.707062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.707336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.708087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] RBAC: Adding query filter params (scope.project.id=a6137b31db374b6ba2f413c885d90346) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:55:05.708393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:05.710310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:05.717233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 664/1338] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:55:05 2022] GET /identity/v3/role_assignments?scope.project.id=a6137b31db374b6ba2f413c885d90346 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:55:05.723150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:05.732337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ec57-6c54-4873-9bbc-f24286d54632 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:05.736750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:05.737589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.737913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.738189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] PATH_INFO: `/v3/users/aaa2e518b932437eacf97c60fa278f8b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.751276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=aaa2e518b932437eacf97c60fa278f8b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:05.753352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675fc6-5622-49fb-98b8-69f599c9ddb8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:05.754950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 675/1339] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:05 2022] GET /identity/v3/users/aaa2e518b932437eacf97c60fa278f8b => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:05.761443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:05.770726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8c09-da51-46c5-9c64-e72639ea9260 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:05.775996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:05.776843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:05.777123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:05.777399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:05.778601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:05.780377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524fe3c-50c4-4dad-b7a3-14f3d03cf798 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:05.781970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 665/1340] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:05 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:08.109184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df010f-7644-4940-8956-3b513328918e None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.109741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df010f-7644-4940-8956-3b513328918e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.109741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df010f-7644-4940-8956-3b513328918e None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.111516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 676/1341] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:08.119164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.119551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.119737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.137591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:08.138814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:08.146565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 666/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:08.169942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df010f-7644-4940-8956-3b513328918e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:08.182847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df010f-7644-4940-8956-3b513328918e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:08.187538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:08.188369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.188650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.188924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] PATH_INFO: `/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.199902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab8cc86db8f54ccc83c6523bb48c82fd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:08.201967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:08.203637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 677/1343] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:55:08 2022] GET /identity/v3/projects/ab8cc86db8f54ccc83c6523bb48c82fd => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:08.210187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:08.219002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697e30-2582-4aae-8e67-ded63a608a6a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:08.223497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:08.224134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.224417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.224696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.225455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] RBAC: Adding query filter params (scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:55:08.225790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:08.227710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:08.233217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 667/1344] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:55:08 2022] GET /identity/v3/role_assignments?scope.project.id=ab8cc86db8f54ccc83c6523bb48c82fd => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:08.239185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:08.249177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6fc79-8f7e-46be-8428-61d0d0ae67b4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:08.253874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:08.254757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.255043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.255321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] PATH_INFO: `/v3/users/937704fcc8cd4bdb9973d69c6e772cd2` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.270106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] RBAC: Authorizing `identity:get_user(user_id=937704fcc8cd4bdb9973d69c6e772cd2)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:08.272253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde491c-3ab1-40eb-acfd-29e291d2b400 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:08.273989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 678/1345] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:08 2022] GET /identity/v3/users/937704fcc8cd4bdb9973d69c6e772cd2 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:08.280351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:08.289766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4df910-a843-4d23-b076-32398cfbff4b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:08.294197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:08.295039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:08.295318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:08.295588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] PATH_INFO: `/v3/users/b907b4b864ad49dfb34b49a3891b43c3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:08.308754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] RBAC: Authorizing `identity:get_user(user_id=b907b4b864ad49dfb34b49a3891b43c3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:08.311161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480408bd-4bf8-4b29-89fe-b28a2289d575 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:08.312870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 668/1346] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:08 2022] GET /identity/v3/users/b907b4b864ad49dfb34b49a3891b43c3 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:10.514239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8c4a-2208-404f-8fc6-0de1ae0d616a None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.514825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8c4a-2208-404f-8fc6-0de1ae0d616a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.514825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8c4a-2208-404f-8fc6-0de1ae0d616a None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.516548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 679/1347] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:10.523956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.524380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.524480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.541669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:10.542880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:10.550392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 669/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:55:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:10.573556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8c4a-2208-404f-8fc6-0de1ae0d616a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:10.585827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8c4a-2208-404f-8fc6-0de1ae0d616a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:10.590687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:10.591521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.591804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.592083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] PATH_INFO: `/v3/projects/c7f118b848914748a8b0a821a6dcbff6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.603286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c7f118b848914748a8b0a821a6dcbff6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:10.605180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:10.606911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 680/1349] 10.222.0.77 () {56 vars in 1207 bytes} [Fri Jan 28 01:55:10 2022] GET /identity/v3/projects/c7f118b848914748a8b0a821a6dcbff6 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:10.613325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:10.622190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eefe4-18e2-4608-8765-4ec27d91b71d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:10.626698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:10.627336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.627619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.627896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.628646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] RBAC: Adding query filter params (scope.project.id=c7f118b848914748a8b0a821a6dcbff6) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:55:10.628977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:10.630845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:10.637351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 670/1350] 10.222.0.77 () {56 vars in 1231 bytes} [Fri Jan 28 01:55:10 2022] GET /identity/v3/role_assignments?scope.project.id=c7f118b848914748a8b0a821a6dcbff6 => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:55:10.643157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:10.652979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381985-5243-4e80-9d50-73ef11c823b9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:10.657459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:10.658338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.658617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.658892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] PATH_INFO: `/v3/users/a75d7081782a44cc9e092a696be2ea52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.660074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75d7081782a44cc9e092a696be2ea52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:10.661873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13d738-ac10-407d-8327-d57a961e5311 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:10.663409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 681/1351] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:10 2022] GET /identity/v3/users/a75d7081782a44cc9e092a696be2ea52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:55:10.669810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:10.679032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa249f3-cae2-478d-98c8-64f27fb7885c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:10.683550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:10.684384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:10.684667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:10.684945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] PATH_INFO: `/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:10.686381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e71bfb6b4004afa9162539ba9f5e8a6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:10.688454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa337c-397e-48a6-bfc9-a7d00ffeb195 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:10.690144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 671/1352] 10.222.0.77 () {56 vars in 1198 bytes} [Fri Jan 28 01:55:10 2022] GET /identity/v3/users/1e71bfb6b4004afa9162539ba9f5e8a6 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:55:16.079279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcda45-8273-42c3-98ff-373008f5b77e None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:16.079837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcda45-8273-42c3-98ff-373008f5b77e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:16.079837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcda45-8273-42c3-98ff-373008f5b77e None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:16.081654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 682/1353] 10.222.0.77 () {54 vars in 918 bytes} [Fri Jan 28 01:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:16.188312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e026-3e62-49ec-9945-8c4ed7f16a12 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:16.188862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e026-3e62-49ec-9945-8c4ed7f16a12 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:16.188862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340e026-3e62-49ec-9945-8c4ed7f16a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:16.206717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f340e026-3e62-49ec-9945-8c4ed7f16a12 None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:16.207895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f340e026-3e62-49ec-9945-8c4ed7f16a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:16.216632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 672/1354] 10.222.0.77 () {58 vars in 1015 bytes} [Fri Jan 28 01:55:16 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:16.231114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2811f-59d3-4a5a-8cfc-fc66483f8f31 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:16.231405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2811f-59d3-4a5a-8cfc-fc66483f8f31 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:16.231689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2811f-59d3-4a5a-8cfc-fc66483f8f31 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:16.233490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 683/1355] 10.222.0.77 () {54 vars in 918 bytes} [Fri Jan 28 01:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:16.238770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77ce4-889f-468d-a382-a9ed37b42d5e None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:16.239057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77ce4-889f-468d-a382-a9ed37b42d5e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:16.239335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb77ce4-889f-468d-a382-a9ed37b42d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:16.256882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-cbb77ce4-889f-468d-a382-a9ed37b42d5e None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:16.258584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cbb77ce4-889f-468d-a382-a9ed37b42d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:16.267801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 673/1356] 10.222.0.77 () {58 vars in 1015 bytes} [Fri Jan 28 01:55:16 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:18.988533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d524-e594-4740-b306-8d8684e0d871 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:18.989129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d524-e594-4740-b306-8d8684e0d871 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:18.989129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d524-e594-4740-b306-8d8684e0d871 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:18.990967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 684/1357] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:18.997946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bbc5c-9bb8-4c39-b474-0200bfea5d8c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:18.998325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bbc5c-9bb8-4c39-b474-0200bfea5d8c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:18.998503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bbc5c-9bb8-4c39-b474-0200bfea5d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:19.015996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c88bbc5c-9bb8-4c39-b474-0200bfea5d8c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:19.017154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c88bbc5c-9bb8-4c39-b474-0200bfea5d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:19.025336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 674/1358] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:19.067011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d524-e594-4740-b306-8d8684e0d871 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:19.081112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d524-e594-4740-b306-8d8684e0d871 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:19.086862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:19.087487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:19.087765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:19.088036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:19.095741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:19.097296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ee9c8-fc5a-4179-b3f2-d9242b0d2b29 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:19.106246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 685/1359] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:19 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:20.526254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c73a3-8a05-4f7a-9975-848b87b30c13 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:20.526759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c73a3-8a05-4f7a-9975-848b87b30c13 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:20.526759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c73a3-8a05-4f7a-9975-848b87b30c13 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:20.528478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 675/1360] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:20.534509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b6ec3-ea31-47ec-bc66-9af05e418917 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:20.534933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b6ec3-ea31-47ec-bc66-9af05e418917 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:20.535079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b6ec3-ea31-47ec-bc66-9af05e418917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:20.552597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-089b6ec3-ea31-47ec-bc66-9af05e418917 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:20.554189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-089b6ec3-ea31-47ec-bc66-9af05e418917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:20.562225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 686/1361] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:20.716464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c73a3-8a05-4f7a-9975-848b87b30c13 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:20.730367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c73a3-8a05-4f7a-9975-848b87b30c13 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:20.735599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:20.736227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:20.736507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:20.736779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:20.744433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:20.746022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834b1b2-0099-4b88-b422-426358e74e40 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:20.754906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 676/1362] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:22.208929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae0bb-4fff-4d73-adf7-65bc71f19f4a None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:22.209479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae0bb-4fff-4d73-adf7-65bc71f19f4a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:22.209479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae0bb-4fff-4d73-adf7-65bc71f19f4a None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:22.211907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 687/1363] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:22.217694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c04d-bf6e-41fa-adf3-9cfc3e4dd4d1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:22.218148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c04d-bf6e-41fa-adf3-9cfc3e4dd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:22.218251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c04d-bf6e-41fa-adf3-9cfc3e4dd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:22.235463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d106c04d-bf6e-41fa-adf3-9cfc3e4dd4d1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:22.236636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d106c04d-bf6e-41fa-adf3-9cfc3e4dd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:22.244235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 677/1364] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:22.397767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae0bb-4fff-4d73-adf7-65bc71f19f4a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:22.411878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae0bb-4fff-4d73-adf7-65bc71f19f4a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:22.417265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:22.417950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:22.418239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:22.418522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:22.426351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:22.427909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f20d8-1e6f-4944-9239-7dd44b791f7f service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:22.437824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 688/1365] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:23.815935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cae2-7e8e-412f-a1f8-273823e27c9d None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:23.816478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cae2-7e8e-412f-a1f8-273823e27c9d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:23.816572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6cae2-7e8e-412f-a1f8-273823e27c9d None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:23.818409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 678/1366] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:23.824147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7e16-7b19-4fd7-81c3-bcba7c5a18af None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:23.824559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7e16-7b19-4fd7-81c3-bcba7c5a18af None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:23.824695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b7e16-7b19-4fd7-81c3-bcba7c5a18af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:23.842490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ef0b7e16-7b19-4fd7-81c3-bcba7c5a18af None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:23.843713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ef0b7e16-7b19-4fd7-81c3-bcba7c5a18af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:23.851575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 689/1367] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:24.003075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cae2-7e8e-412f-a1f8-273823e27c9d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:24.016769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6cae2-7e8e-412f-a1f8-273823e27c9d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:24.022039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:24.022674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:24.022954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:24.023226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:24.031535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:24.033081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03dd34-1135-4151-9120-21a1e96267b2 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:24.042768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 679/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:24 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:25.446372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf85a9-b409-4fc1-9f5e-cd93bfdbfb42 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:25.446949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf85a9-b409-4fc1-9f5e-cd93bfdbfb42 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:25.446949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf85a9-b409-4fc1-9f5e-cd93bfdbfb42 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:25.448713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 690/1369] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:25.454388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14e3-9fe8-49af-9d02-697b26188d6c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:25.454807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14e3-9fe8-49af-9d02-697b26188d6c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:25.454950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d14e3-9fe8-49af-9d02-697b26188d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:25.472718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5a5d14e3-9fe8-49af-9d02-697b26188d6c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:25.473988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5a5d14e3-9fe8-49af-9d02-697b26188d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:25.482253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 680/1370] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:25.635460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf85a9-b409-4fc1-9f5e-cd93bfdbfb42 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:25.649797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf85a9-b409-4fc1-9f5e-cd93bfdbfb42 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:25.656072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:25.656711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:25.656989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:25.657261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:25.665709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:25.667296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2057cad-e555-413e-916f-4d9e7a21c2b7 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:25.676570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 691/1371] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:55:27.014378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec3f2-e577-46f7-b99c-5a7c87d149dd None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:27.014935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec3f2-e577-46f7-b99c-5a7c87d149dd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:27.014935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec3f2-e577-46f7-b99c-5a7c87d149dd None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:27.016771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 681/1372] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:27.022550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40653421-243e-451f-8a96-3f6f23b26e88 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:27.022973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40653421-243e-451f-8a96-3f6f23b26e88 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:27.023108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40653421-243e-451f-8a96-3f6f23b26e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:27.040202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-40653421-243e-451f-8a96-3f6f23b26e88 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:27.041373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-40653421-243e-451f-8a96-3f6f23b26e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:27.048938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 692/1373] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:27.205405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec3f2-e577-46f7-b99c-5a7c87d149dd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:27.219219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec3f2-e577-46f7-b99c-5a7c87d149dd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:27.224495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:27.225120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:27.225400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:27.225675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:27.233988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:27.235545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c9b60-9e2e-4c73-af33-8992b14a6247 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:27.245019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 682/1374] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:28.589283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e670-7264-4d2d-aae2-6dfc4e8c1171 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:28.589806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e670-7264-4d2d-aae2-6dfc4e8c1171 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:28.589806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e670-7264-4d2d-aae2-6dfc4e8c1171 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:28.591546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 693/1375] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:28.597287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d8bc-6f8f-4bdc-9c19-e9b612ca51cf None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:28.597664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d8bc-6f8f-4bdc-9c19-e9b612ca51cf None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:28.597902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d8bc-6f8f-4bdc-9c19-e9b612ca51cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:28.615298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-60b1d8bc-6f8f-4bdc-9c19-e9b612ca51cf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:28.616537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-60b1d8bc-6f8f-4bdc-9c19-e9b612ca51cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:28.624921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 683/1376] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:28.778427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039e670-7264-4d2d-aae2-6dfc4e8c1171 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:28.792744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039e670-7264-4d2d-aae2-6dfc4e8c1171 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:28.798089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:28.798723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:28.799013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:28.799295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:28.807717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:28.809321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd7b5e-015a-40e6-a780-db65042d6c48 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:28.818777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 694/1377] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:30.160601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04567-77e8-4a79-ae3e-1095c540b6f7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:30.161156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04567-77e8-4a79-ae3e-1095c540b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:30.161156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d04567-77e8-4a79-ae3e-1095c540b6f7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:30.162954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 684/1378] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:30.169321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8abc6-8df5-47cd-8620-23312faa379e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:30.169716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8abc6-8df5-47cd-8620-23312faa379e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:30.169902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8abc6-8df5-47cd-8620-23312faa379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:30.187302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e2a8abc6-8df5-47cd-8620-23312faa379e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:30.188479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e2a8abc6-8df5-47cd-8620-23312faa379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:30.196152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 695/1379] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:30.354262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d04567-77e8-4a79-ae3e-1095c540b6f7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:30.368046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d04567-77e8-4a79-ae3e-1095c540b6f7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:30.373367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:30.374024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:30.374305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:30.374581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:30.382298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:30.384373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bd557-b8d9-40b3-9969-f101a6b1183b service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:30.393324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 685/1380] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:31.742184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cdf0-40dc-499e-aa46-71b945c09cb3 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:31.742756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cdf0-40dc-499e-aa46-71b945c09cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:31.742756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cdf0-40dc-499e-aa46-71b945c09cb3 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:31.744497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 696/1381] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:31.750732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df42-48bb-4434-9091-606a33ae3f3c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:31.751149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df42-48bb-4434-9091-606a33ae3f3c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:31.751288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9df42-48bb-4434-9091-606a33ae3f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:31.768327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2dc9df42-48bb-4434-9091-606a33ae3f3c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:31.769506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2dc9df42-48bb-4434-9091-606a33ae3f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:31.777549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 686/1382] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:55:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:55:31.939009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cdf0-40dc-499e-aa46-71b945c09cb3 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:31.952768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cdf0-40dc-499e-aa46-71b945c09cb3 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:31.958011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:31.958640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:31.958923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:31.959198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:31.966929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:31.968512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e016db-63a7-44ef-b57f-711288857e2a service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:31.978033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 697/1383] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:34.055210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc34a6-0cf8-4b7f-877c-a11293efc924 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:34.055704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc34a6-0cf8-4b7f-877c-a11293efc924 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:34.055823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc34a6-0cf8-4b7f-877c-a11293efc924 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:34.057576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 687/1384] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:34.065116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45b5b4-0b27-49e9-bf99-c309680aa8d5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:34.065538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45b5b4-0b27-49e9-bf99-c309680aa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:34.065663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45b5b4-0b27-49e9-bf99-c309680aa8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:34.082959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5a45b5b4-0b27-49e9-bf99-c309680aa8d5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:34.084146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5a45b5b4-0b27-49e9-bf99-c309680aa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:34.091744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 698/1385] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:34.131268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc34a6-0cf8-4b7f-877c-a11293efc924 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:34.141502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc34a6-0cf8-4b7f-877c-a11293efc924 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:34.144962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:34.145586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:34.145898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:34.146175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:34.154607 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:34.156012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4713e-341c-47dc-999b-f73cc5bc5b23 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:34.165326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 688/1386] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:36.453175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329771e-f429-4802-9397-5fa165ca671f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:36.453695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329771e-f429-4802-9397-5fa165ca671f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:36.453813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329771e-f429-4802-9397-5fa165ca671f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:36.455511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 699/1387] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:36.463107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec52a2-bb1d-4dd3-94df-66e64ec40b59 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:36.463513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec52a2-bb1d-4dd3-94df-66e64ec40b59 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:36.463667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec52a2-bb1d-4dd3-94df-66e64ec40b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:36.485826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ebec52a2-bb1d-4dd3-94df-66e64ec40b59 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:36.487028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ebec52a2-bb1d-4dd3-94df-66e64ec40b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:36.494872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 689/1388] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:36.535142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329771e-f429-4802-9397-5fa165ca671f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:36.545475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329771e-f429-4802-9397-5fa165ca671f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:36.548978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:36.549614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:36.549942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:36.550225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:36.558698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:36.560123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30052a2-c2ef-467d-a1b8-862d6e767396 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:36.569436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 700/1389] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:39.040630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25b05-d6ab-44f3-84fa-6fa05ec267d7 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:39.041168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25b05-d6ab-44f3-84fa-6fa05ec267d7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:39.041168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25b05-d6ab-44f3-84fa-6fa05ec267d7 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:39.043033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 690/1390] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:39.050190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1574-c312-483a-a35e-fd7c81585777 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:39.050568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1574-c312-483a-a35e-fd7c81585777 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:39.050756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1574-c312-483a-a35e-fd7c81585777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:39.069107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3a7e1574-c312-483a-a35e-fd7c81585777 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:39.070352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3a7e1574-c312-483a-a35e-fd7c81585777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:39.078005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 701/1391] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:39.116935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25b05-d6ab-44f3-84fa-6fa05ec267d7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:39.127271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25b05-d6ab-44f3-84fa-6fa05ec267d7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:39.130688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:39.131315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:39.131595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:39.131867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:39.140295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:39.141704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da62786-7704-4bb0-b9d0-2749a2fe8848 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:39.151149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 691/1392] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:41.413040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9539-c761-40cb-854c-da3d5f31e264 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:41.413633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9539-c761-40cb-854c-da3d5f31e264 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:41.413633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9539-c761-40cb-854c-da3d5f31e264 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:41.415437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 702/1393] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:55:41.422495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7b71-2994-457a-86b5-96197332378b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:41.423034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7b71-2994-457a-86b5-96197332378b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:41.423034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb7b71-2994-457a-86b5-96197332378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:41.441780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b4bb7b71-2994-457a-86b5-96197332378b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:41.442973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b4bb7b71-2994-457a-86b5-96197332378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:41.451482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 692/1394] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:41.490576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9539-c761-40cb-854c-da3d5f31e264 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:41.503103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9539-c761-40cb-854c-da3d5f31e264 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:41.506790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:41.507429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:41.507713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:41.507992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:41.516864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:41.518348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f34aba-56a6-47ae-a32c-b37938c54ad3 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:41.527491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 703/1395] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:43.853525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc40d2-39ba-413d-9821-a2c6c6a72c77 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:43.854130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc40d2-39ba-413d-9821-a2c6c6a72c77 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:43.854130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc40d2-39ba-413d-9821-a2c6c6a72c77 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:43.855862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 693/1396] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:43.863330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a290-fdbd-4937-bd90-6efa6efa905d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:43.863757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a290-fdbd-4937-bd90-6efa6efa905d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:43.863867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333a290-fdbd-4937-bd90-6efa6efa905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:43.882685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f333a290-fdbd-4937-bd90-6efa6efa905d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:43.884366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f333a290-fdbd-4937-bd90-6efa6efa905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:43.893121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 704/1397] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:43.932862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc40d2-39ba-413d-9821-a2c6c6a72c77 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:43.943471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc40d2-39ba-413d-9821-a2c6c6a72c77 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:43.946959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:43.947588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:43.947868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:43.948141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:43.956622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:43.958055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f6fb9-55ea-4e5d-bf9e-ca3332d60e4d service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:43.966977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 694/1398] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:46.251784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947009f-c1fa-4454-b29f-5754c9c90a76 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:46.252338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947009f-c1fa-4454-b29f-5754c9c90a76 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:46.252338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947009f-c1fa-4454-b29f-5754c9c90a76 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:46.254155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 705/1399] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:46.261610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de38d-7280-432c-99e1-921f2a3c9aa4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:46.262095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de38d-7280-432c-99e1-921f2a3c9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:46.262220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012de38d-7280-432c-99e1-921f2a3c9aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:46.279387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-012de38d-7280-432c-99e1-921f2a3c9aa4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:46.280555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-012de38d-7280-432c-99e1-921f2a3c9aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:46.288652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 695/1400] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:46.328233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947009f-c1fa-4454-b29f-5754c9c90a76 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:46.338921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947009f-c1fa-4454-b29f-5754c9c90a76 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:46.342663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:46.343556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:46.343852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:46.344170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:46.354648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:46.356074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0df34-9462-437b-84ef-c9543f6fbd45 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:46.366270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 706/1401] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:48.565530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c17b7e-4b1f-4dc2-9ab4-e0c5e7215ef5 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:48.566113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c17b7e-4b1f-4dc2-9ab4-e0c5e7215ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:48.566113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c17b7e-4b1f-4dc2-9ab4-e0c5e7215ef5 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:48.567817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 696/1402] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:48.575237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62f97-99dc-4207-bb3a-6f47489c6c08 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:48.575669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62f97-99dc-4207-bb3a-6f47489c6c08 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:48.575780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad62f97-99dc-4207-bb3a-6f47489c6c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:48.593527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2ad62f97-99dc-4207-bb3a-6f47489c6c08 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:48.594738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2ad62f97-99dc-4207-bb3a-6f47489c6c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:48.602344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 707/1403] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:48.640352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c17b7e-4b1f-4dc2-9ab4-e0c5e7215ef5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:48.650973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c17b7e-4b1f-4dc2-9ab4-e0c5e7215ef5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:48.654435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84903182-245c-4912-a253-16525a334703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:48.655062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903182-245c-4912-a253-16525a334703 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:48.655342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903182-245c-4912-a253-16525a334703 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:48.655619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903182-245c-4912-a253-16525a334703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:48.664262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84903182-245c-4912-a253-16525a334703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:48.665676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84903182-245c-4912-a253-16525a334703 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:48.676545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 697/1404] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:50.870129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59254b2-fa95-434a-8246-a8c3a6fd8acd None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:50.870710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59254b2-fa95-434a-8246-a8c3a6fd8acd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:50.870710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59254b2-fa95-434a-8246-a8c3a6fd8acd None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:50.872442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 708/1405] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:50.879707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a774-ce32-4a48-a778-3b374b78ba45 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:50.880126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a774-ce32-4a48-a778-3b374b78ba45 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:50.880225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7a774-ce32-4a48-a778-3b374b78ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:50.898002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a5a7a774-ce32-4a48-a778-3b374b78ba45 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:50.899177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a5a7a774-ce32-4a48-a778-3b374b78ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:50.906815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 698/1406] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:50.944755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59254b2-fa95-434a-8246-a8c3a6fd8acd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:50.955150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59254b2-fa95-434a-8246-a8c3a6fd8acd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:50.958674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:50.959791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:50.960075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:50.960351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:50.968853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:50.970296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c75a-3e8a-416a-aa32-7ec12aac5bba service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:50.979860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 709/1407] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:53.156248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc79e-01a8-476b-8db1-ed3044a531b8 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:53.156827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc79e-01a8-476b-8db1-ed3044a531b8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:53.156827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc79e-01a8-476b-8db1-ed3044a531b8 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:53.158631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 699/1408] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:53.165653 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5382-6b95-48dd-9b3f-6ebb689ec4fe None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:53.166088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5382-6b95-48dd-9b3f-6ebb689ec4fe None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:53.166327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5382-6b95-48dd-9b3f-6ebb689ec4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:53.184062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6e4f5382-6b95-48dd-9b3f-6ebb689ec4fe None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:53.185256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6e4f5382-6b95-48dd-9b3f-6ebb689ec4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:53.193411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 710/1409] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:53.230213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc79e-01a8-476b-8db1-ed3044a531b8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:53.240976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc79e-01a8-476b-8db1-ed3044a531b8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:53.244462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:53.245090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:53.245369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:53.245641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:53.254244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:53.255665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a0321-ff37-4c62-9c92-864783ff9172 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:53.265327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 700/1410] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:55.421557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6f93-81c3-4dc8-8c44-076d3c60fa7f None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:55.422146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6f93-81c3-4dc8-8c44-076d3c60fa7f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:55.422146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6f93-81c3-4dc8-8c44-076d3c60fa7f None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:55.423961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 711/1411] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:55.430983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6c86-36fe-46c5-b1d0-565088a8f8c4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:55.431413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6c86-36fe-46c5-b1d0-565088a8f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:55.431517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a6c86-36fe-46c5-b1d0-565088a8f8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:55.448938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f16a6c86-36fe-46c5-b1d0-565088a8f8c4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:55.450143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f16a6c86-36fe-46c5-b1d0-565088a8f8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:55.457836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 701/1412] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:55.495133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e6f93-81c3-4dc8-8c44-076d3c60fa7f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:55.505261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e6f93-81c3-4dc8-8c44-076d3c60fa7f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:55.508736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:55.509352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:55.509631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:55.509938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:55.518332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:55.519725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6df45d-3314-4a70-b8be-ea8e99a1b4bf service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:55.529237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 712/1413] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:07.953602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7f5f-e336-449b-b6e5-97f43ce606f5 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:07.954194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7f5f-e336-449b-b6e5-97f43ce606f5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:07.954194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff7f5f-e336-449b-b6e5-97f43ce606f5 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:07.955944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 702/1414] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:07.962786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cd2d0-35f2-4cd7-ba72-38f45f665e21 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:07.963173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cd2d0-35f2-4cd7-ba72-38f45f665e21 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:07.963347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cd2d0-35f2-4cd7-ba72-38f45f665e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:07.980536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3a1cd2d0-35f2-4cd7-ba72-38f45f665e21 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:07.981728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3a1cd2d0-35f2-4cd7-ba72-38f45f665e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:07.989496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 713/1415] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:08.037800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92569e-3e64-447f-8223-9a20af0344d5 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:08.038095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92569e-3e64-447f-8223-9a20af0344d5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:08.038372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92569e-3e64-447f-8223-9a20af0344d5 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:08.040118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 703/1416] 10.222.0.77 () {54 vars in 961 bytes} [Fri Jan 28 01:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:08.045197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c60c6-a82c-40f6-aa68-47508fde8ea3 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:08.045483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c60c6-a82c-40f6-aa68-47508fde8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:08.045788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c60c6-a82c-40f6-aa68-47508fde8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:08.063431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-341c60c6-a82c-40f6-aa68-47508fde8ea3 None None] MFA Rules not processed for user `4799e6d178524148b5aea9a28ddc5145`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:08.064624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-341c60c6-a82c-40f6-aa68-47508fde8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:08.071386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 714/1417] 10.222.0.77 () {58 vars in 1058 bytes} [Fri Jan 28 01:56:08 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:08.078743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92569e-3e64-447f-8223-9a20af0344d5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:08.089537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92569e-3e64-447f-8223-9a20af0344d5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:08.093218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:08.093875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:08.094193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:08.094468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:08.103200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:08.104621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729191-ef19-4df1-9f53-e138c61ed10e service glance] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:08.113684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 704/1418] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:08 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:10.337213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a331d-e460-4f6e-9ea9-5fd96d67c4bf None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:10.337769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a331d-e460-4f6e-9ea9-5fd96d67c4bf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:10.337769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a331d-e460-4f6e-9ea9-5fd96d67c4bf None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:10.339566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 715/1419] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:10.346604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edfb00-ff51-4eec-9948-f710d02803c8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:10.347047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edfb00-ff51-4eec-9948-f710d02803c8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:10.347154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edfb00-ff51-4eec-9948-f710d02803c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:10.364857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-25edfb00-ff51-4eec-9948-f710d02803c8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:10.366064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-25edfb00-ff51-4eec-9948-f710d02803c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:10.374065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 705/1420] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:10.398200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a331d-e460-4f6e-9ea9-5fd96d67c4bf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:10.410085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a331d-e460-4f6e-9ea9-5fd96d67c4bf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:10.415068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:10.415710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:10.415994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:10.416272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:10.417021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:10.418938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8393d-8c43-4bdc-9d6f-c560407b9ad1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:10.431879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 716/1421] 10.222.0.77 () {56 vars in 1108 bytes} [Fri Jan 28 01:56:10 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:12.588629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc356e-de46-4853-b93c-f6ca47ca6f6a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:12.589178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc356e-de46-4853-b93c-f6ca47ca6f6a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:12.589178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc356e-de46-4853-b93c-f6ca47ca6f6a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:12.590939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 706/1422] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:12.598218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021de7-d220-4c43-9eaa-312d615e25ea None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:12.598648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021de7-d220-4c43-9eaa-312d615e25ea None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:12.598783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021de7-d220-4c43-9eaa-312d615e25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:12.616500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a0021de7-d220-4c43-9eaa-312d615e25ea None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:12.617683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a0021de7-d220-4c43-9eaa-312d615e25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:12.625336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 717/1423] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:12.668027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc356e-de46-4853-b93c-f6ca47ca6f6a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:12.682186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc356e-de46-4853-b93c-f6ca47ca6f6a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:12.687598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:12.688221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:12.688500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:12.688774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:12.697083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:12.698682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30d68c-25b3-4499-affc-58ed978e5c8f service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:12.707634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 707/1424] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:15.040343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01317-54f7-4e34-aa0d-adaa0657faef None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:15.040907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01317-54f7-4e34-aa0d-adaa0657faef None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:15.040907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a01317-54f7-4e34-aa0d-adaa0657faef None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:15.042753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 718/1425] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:15.049937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733a52-f2f1-4400-80bc-a03e76b96e1a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:15.050358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733a52-f2f1-4400-80bc-a03e76b96e1a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:15.050496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733a52-f2f1-4400-80bc-a03e76b96e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:15.067991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-12733a52-f2f1-4400-80bc-a03e76b96e1a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:15.069170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-12733a52-f2f1-4400-80bc-a03e76b96e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:15.076834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 708/1426] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:15.113564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a01317-54f7-4e34-aa0d-adaa0657faef None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:15.124025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a01317-54f7-4e34-aa0d-adaa0657faef None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:15.127510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:15.128142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:15.128426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:15.128705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:15.137222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:15.138677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1e20c-7608-4202-ba86-f1a39b760a14 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:15.148440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 719/1427] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:15 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:17.385036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881416c-6e4e-424f-93ba-270548d85944 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:17.385598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881416c-6e4e-424f-93ba-270548d85944 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:17.385598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881416c-6e4e-424f-93ba-270548d85944 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:17.387366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 709/1428] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:17.394573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67550-ee67-4a9d-848e-3a90f04baae4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:17.394987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67550-ee67-4a9d-848e-3a90f04baae4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:17.395202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67550-ee67-4a9d-848e-3a90f04baae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:17.412716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b8a67550-ee67-4a9d-848e-3a90f04baae4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:17.413942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b8a67550-ee67-4a9d-848e-3a90f04baae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:17.421639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 720/1429] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:17.461348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881416c-6e4e-424f-93ba-270548d85944 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:17.471623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881416c-6e4e-424f-93ba-270548d85944 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:17.475629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:17.476258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:17.476542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:17.476825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:17.485383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:17.486823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae8d02-46a7-45ac-92be-30de55390809 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:17.496425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 710/1430] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:19.775185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92d75-8cd2-436f-a35d-f446840c4ff0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:19.775744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92d75-8cd2-436f-a35d-f446840c4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:19.775744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92d75-8cd2-436f-a35d-f446840c4ff0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:19.777500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 721/1431] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:19.784651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cce2-b30a-4ff8-b8c4-c1c257f6b006 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:19.785089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cce2-b30a-4ff8-b8c4-c1c257f6b006 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:19.785195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cce2-b30a-4ff8-b8c4-c1c257f6b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:19.802879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bc37cce2-b30a-4ff8-b8c4-c1c257f6b006 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:19.804057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bc37cce2-b30a-4ff8-b8c4-c1c257f6b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:19.812081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 711/1432] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:19.853131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92d75-8cd2-436f-a35d-f446840c4ff0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:19.863690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92d75-8cd2-436f-a35d-f446840c4ff0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:19.867176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:19.867803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:19.868083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:19.868361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:19.876741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:19.878187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28fe0-ece4-4d57-af59-47ec24ff8e5a service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:19.887810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 722/1433] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:19 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:22.227966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6fdc9-0821-427c-9bd1-ec46a58e8581 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:22.228537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6fdc9-0821-427c-9bd1-ec46a58e8581 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:22.228537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6fdc9-0821-427c-9bd1-ec46a58e8581 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:22.230335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 712/1434] 10.222.0.77 () {54 vars in 926 bytes} [Fri Jan 28 01:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:22.237265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473e5-49e0-4091-b59e-66fc64a229e9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:22.237701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473e5-49e0-4091-b59e-66fc64a229e9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:22.237869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473e5-49e0-4091-b59e-66fc64a229e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:22.257033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-93a473e5-49e0-4091-b59e-66fc64a229e9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:22.258262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-93a473e5-49e0-4091-b59e-66fc64a229e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:22.267103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 723/1435] 10.222.0.77 () {58 vars in 1023 bytes} [Fri Jan 28 01:56:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:22.306884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6fdc9-0821-427c-9bd1-ec46a58e8581 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:22.317426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6fdc9-0821-427c-9bd1-ec46a58e8581 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:22.320904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:22.321534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:22.321841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:22.322116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:22.330528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:22.331958 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec494-06e4-4c9e-830e-d6dc212498ca service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:22.341339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 713/1436] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:37.974504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eda07-849c-4b37-82aa-713d61258624 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.975112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eda07-849c-4b37-82aa-713d61258624 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.975112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859eda07-849c-4b37-82aa-713d61258624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.992925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-859eda07-849c-4b37-82aa-713d61258624 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:37.994124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-859eda07-849c-4b37-82aa-713d61258624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.001710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 724/1437] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.009496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.010001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.010097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.027310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.028517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.036799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 714/1438] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.041071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eda07-849c-4b37-82aa-713d61258624 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.051185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859eda07-849c-4b37-82aa-713d61258624 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.055744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.056392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.056673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.056975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.057682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:38.058016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.059852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.070820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 725/1439] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:38.078714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.088120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea846e-c6d9-419b-bba8-9bb5e38c5cc6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.092757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.093409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.093698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.094007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.094798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.096710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.131077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 715/1440] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:38.135123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.144595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b85ce-7661-4103-ba7f-306faa3964a8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.197039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.197695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.198005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.198279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.198954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.200846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.219290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 726/1441] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/users => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:38.224712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.234474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0a55f-a2ff-45ec-8d12-f51567e5c9b5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.239604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.240266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.240552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.240848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.241547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.243201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.256844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 716/1442] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:38.260731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.270282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a6721-29e9-4a7f-b8f2-e3064611e0b1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.274757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.275415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.275695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.275973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.276685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.278319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2b23-9de1-4c0d-b78f-88324745fcb2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.291520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 727/1443] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:38.295664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.305846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2747fbe-f66d-4530-8bb5-897e4d438afb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.310815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.311690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.311968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.312241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] PATH_INFO: `/v3/projects/ef6b9977c47240149db4c7942fc96f8b/users/50dec16f42df4cb98fd3457b1f94e8a0/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.326111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6b9977c47240149db4c7942fc96f8b, user_id=50dec16f42df4cb98fd3457b1f94e8a0, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.329250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.341372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 717/1444] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:38 2022] PUT /identity/v3/projects/ef6b9977c47240149db4c7942fc96f8b/users/50dec16f42df4cb98fd3457b1f94e8a0/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:38.354683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408b49-0d26-4ef4-9179-351f88ad5961 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.355042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408b49-0d26-4ef4-9179-351f88ad5961 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.355559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2408b49-0d26-4ef4-9179-351f88ad5961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.383416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e2408b49-0d26-4ef4-9179-351f88ad5961 None None] MFA Rules not processed for user `50dec16f42df4cb98fd3457b1f94e8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.384634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e2408b49-0d26-4ef4-9179-351f88ad5961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.445927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 728/1445] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.457670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.527774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a554bf-a76f-4b30-9c0a-ab4e7690ceef admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.533075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.533753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.534061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.534340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.541679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.543308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.551681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 718/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:38.619736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560d2-df4b-4886-acc0-b4822b73e8ae None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.620052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560d2-df4b-4886-acc0-b4822b73e8ae None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.620357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee560d2-df4b-4886-acc0-b4822b73e8ae None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.622165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 729/1447] 10.222.0.77 () {52 vars in 829 bytes} [Fri Jan 28 01:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:38.626176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.685501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702fc1c-92d0-4c33-99d9-50a8c4017965 service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.690526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.691379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.691660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.691932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] PATH_INFO: `/v3/users/50dec16f42df4cb98fd3457b1f94e8a0` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.693096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50dec16f42df4cb98fd3457b1f94e8a0)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.694143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:38.694143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 01:57:38.694143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 01:57:38.695343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.760867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50dec16f42df4cb98fd3457b1f94e8a0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:38.761637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50dec16f42df4cb98fd3457b1f94e8a0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:38.762282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50dec16f42df4cb98fd3457b1f94e8a0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:38.771609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50dec16f42df4cb98fd3457b1f94e8a0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:38.783530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50dec16f42df4cb98fd3457b1f94e8a0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:38.807368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 719/1448] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:38 2022] DELETE /identity/v3/users/50dec16f42df4cb98fd3457b1f94e8a0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:38.812040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.812328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.812617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.830305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.831478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.885274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 730/1449] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.895142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.896523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.950133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42fb8e-9adc-4531-bbe1-8ad3831486d6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.953723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.954403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.954689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.954968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.963390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.964822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a7af6-bb84-4795-b0d0-6fb6dcb6e63a service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.974084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 720/1450] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:39.284990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.286487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.299174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4240f84-2a2a-45ed-b33f-33db4c5ebb34 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.303877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.304736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.305017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.305351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] PATH_INFO: `/v3/projects/ef6b9977c47240149db4c7942fc96f8b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.306504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6b9977c47240149db4c7942fc96f8b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.307523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:57:39.307523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 01:57:39.307523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 01:57:39.308729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.366513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6b9977c47240149db4c7942fc96f8b', 'request_id': 'req-b86e3526-7e72-417e-99d4-43d6c26d1e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.375229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6b9977c47240149db4c7942fc96f8b', 'request_id': 'req-b86e3526-7e72-417e-99d4-43d6c26d1e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.389299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6b9977c47240149db4c7942fc96f8b', 'request_id': 'req-b86e3526-7e72-417e-99d4-43d6c26d1e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.400025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] The token cache is being invalidate because project ef6b9977c47240149db4c7942fc96f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:39.400318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.401058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-b86e3526-7e72-417e-99d4-43d6c26d1e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.402606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 731/1451] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:39 2022] DELETE /identity/v3/projects/ef6b9977c47240149db4c7942fc96f8b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:10.159554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c88-f54e-4eb0-9db6-de96d350d890 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.160150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c88-f54e-4eb0-9db6-de96d350d890 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.160150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956c88-f54e-4eb0-9db6-de96d350d890 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.161971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 721/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:10.167315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6ed3-811b-49fb-bc02-bd93b36ede1f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.167741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6ed3-811b-49fb-bc02-bd93b36ede1f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.167873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed6ed3-811b-49fb-bc02-bd93b36ede1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.185579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-94ed6ed3-811b-49fb-bc02-bd93b36ede1f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:10.186793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-94ed6ed3-811b-49fb-bc02-bd93b36ede1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:10.242100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 732/1453] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:10.341603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.341915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.342196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] PATH_INFO: `/v3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.343501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 722/1454] 10.222.0.82 () {54 vars in 925 bytes} [Fri Jan 28 01:59:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:10.350417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ede2b3-9e8f-4fb8-b765-5fe8e9fc3cf4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.350716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ede2b3-9e8f-4fb8-b765-5fe8e9fc3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.351000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ede2b3-9e8f-4fb8-b765-5fe8e9fc3cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.369059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-98ede2b3-9e8f-4fb8-b765-5fe8e9fc3cf4 None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:10.370292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-98ede2b3-9e8f-4fb8-b765-5fe8e9fc3cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:10.393087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:10.394841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:10.429599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 733/1455] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Jan 28 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:10.465562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b3c4-4311-4667-af60-2d9c16a1dbe2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:10.470941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:10.471585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.471896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.472174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.480073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:10.481671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225297c2-e7ee-4943-87b0-e0673032f8c6 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:10.491168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 723/1456] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:11.866003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3ff5-acfb-4227-bb47-f2874b815dd0 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:11.866488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3ff5-acfb-4227-bb47-f2874b815dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:11.866612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab3ff5-acfb-4227-bb47-f2874b815dd0 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:11.868403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 734/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:11.874060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed778fb-ef3e-4bdf-9e04-f482c8bbba5b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:11.874506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed778fb-ef3e-4bdf-9e04-f482c8bbba5b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:11.874603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed778fb-ef3e-4bdf-9e04-f482c8bbba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:11.892594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8ed778fb-ef3e-4bdf-9e04-f482c8bbba5b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:11.894243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8ed778fb-ef3e-4bdf-9e04-f482c8bbba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:11.901902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 724/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:12.053730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab3ff5-acfb-4227-bb47-f2874b815dd0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:12.068424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab3ff5-acfb-4227-bb47-f2874b815dd0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:12.073765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:12.074404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.074686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.074963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.082945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:12.084514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fee5d-cc43-4ff0-b872-455d33d731f1 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:12.093495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 735/1459] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:18.809455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4cc4-0308-44c8-babb-43365f7e1ba6 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:18.809914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4cc4-0308-44c8-babb-43365f7e1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:18.810038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4cc4-0308-44c8-babb-43365f7e1ba6 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:18.811791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 725/1460] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 01:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:18.818434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932d1b-c910-4035-b401-139dfb06998f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:18.818888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932d1b-c910-4035-b401-139dfb06998f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:18.819016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a932d1b-c910-4035-b401-139dfb06998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:18.836322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-1a932d1b-c910-4035-b401-139dfb06998f None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:18.837498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1a932d1b-c910-4035-b401-139dfb06998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:18.845780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 736/1461] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 01:59:18 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:18.854868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c4cc4-0308-44c8-babb-43365f7e1ba6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:18.868523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c4cc4-0308-44c8-babb-43365f7e1ba6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:18.873613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:18.874307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:18.874593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:18.874874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:18.883429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:18.885014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5a246-e0b0-4eba-a817-99ee040920d3 service placement] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:18.894320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 726/1462] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:18 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:23.886481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d458a-9dd7-488f-afcc-39cc86b1d261 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:23.887047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d458a-9dd7-488f-afcc-39cc86b1d261 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:23.887047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d458a-9dd7-488f-afcc-39cc86b1d261 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:23.888783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 737/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:23.894776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b53fe-b20d-41bd-b7a7-272f7dcd79c4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:23.895226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b53fe-b20d-41bd-b7a7-272f7dcd79c4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:23.895328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b53fe-b20d-41bd-b7a7-272f7dcd79c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:23.914342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-437b53fe-b20d-41bd-b7a7-272f7dcd79c4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:23.915540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-437b53fe-b20d-41bd-b7a7-272f7dcd79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:23.924085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 727/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:24.075292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d458a-9dd7-488f-afcc-39cc86b1d261 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:24.089895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d458a-9dd7-488f-afcc-39cc86b1d261 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:24.095246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:24.095881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:24.096166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:24.096447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:24.104226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:24.105810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e2b5-31cf-4cfd-9b47-2c33713c691a service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:24.114823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 738/1465] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:24 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:25.474401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30760-c68a-45d1-a670-524508d76c2a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.474954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30760-c68a-45d1-a670-524508d76c2a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.475066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30760-c68a-45d1-a670-524508d76c2a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.476755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 728/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:25.482170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71b89-bd47-4e14-8c7c-8d78662321ef None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.482595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71b89-bd47-4e14-8c7c-8d78662321ef None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.482739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71b89-bd47-4e14-8c7c-8d78662321ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.501776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2ab71b89-bd47-4e14-8c7c-8d78662321ef None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:25.502973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2ab71b89-bd47-4e14-8c7c-8d78662321ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:25.510735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 739/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:25.665241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30760-c68a-45d1-a670-524508d76c2a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:25.678994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30760-c68a-45d1-a670-524508d76c2a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:25.684525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:25.685153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.685434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.685707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.693982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:25.695539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647dfee-3a0d-4d25-a451-6978ba871a1d service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:25.704649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 729/1468] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:29.741512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:29.742069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:29.742166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:29.743872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 740/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:29.751217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a08d-71ae-446d-b31c-64d1eb391c9f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:29.751692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a08d-71ae-446d-b31c-64d1eb391c9f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:29.751896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474a08d-71ae-446d-b31c-64d1eb391c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:29.770145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9474a08d-71ae-446d-b31c-64d1eb391c9f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:29.771590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9474a08d-71ae-446d-b31c-64d1eb391c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:29.779794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 730/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:29.817184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:29.818859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:29.872202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc138-d937-4338-abde-f8b4ba77af68 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:29.875675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:29.876315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:29.876594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:29.876867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:29.885963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:29.887366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f7767-abac-40dd-ab5d-f2b34f0cbdb1 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:29.896371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 741/1471] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:32.131936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41497-05a9-4e90-b145-14b957658142 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:32.132507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41497-05a9-4e90-b145-14b957658142 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:32.132507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc41497-05a9-4e90-b145-14b957658142 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:32.134339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 731/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:32.141705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe30c6-904e-4bd3-9fac-cb90dc5b6d4a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:32.142168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe30c6-904e-4bd3-9fac-cb90dc5b6d4a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:32.142360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe30c6-904e-4bd3-9fac-cb90dc5b6d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:32.160077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-40fe30c6-904e-4bd3-9fac-cb90dc5b6d4a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:32.161262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-40fe30c6-904e-4bd3-9fac-cb90dc5b6d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:32.169012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 742/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:32.206055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc41497-05a9-4e90-b145-14b957658142 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:32.216728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc41497-05a9-4e90-b145-14b957658142 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:32.220348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:32.220987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:32.221273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:32.221555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:32.230224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:32.231651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86f388-a4a6-4c81-a06c-721e6a9859b7 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:32.241229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 732/1474] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:35.922571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969352-7d08-405c-9223-296d30c013a5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:35.923122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969352-7d08-405c-9223-296d30c013a5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:35.923205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36969352-7d08-405c-9223-296d30c013a5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:35.924931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 743/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:35.931790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43af6-12fc-41ca-bb67-6c6ba26b33f9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:35.932232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43af6-12fc-41ca-bb67-6c6ba26b33f9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:35.932355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43af6-12fc-41ca-bb67-6c6ba26b33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:35.950105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d7f43af6-12fc-41ca-bb67-6c6ba26b33f9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:35.951281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d7f43af6-12fc-41ca-bb67-6c6ba26b33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:35.959434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 733/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:36.009550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36969352-7d08-405c-9223-296d30c013a5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:36.011235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-36969352-7d08-405c-9223-296d30c013a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:36.070879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36969352-7d08-405c-9223-296d30c013a5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:36.076175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:36.076942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:36.077229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:36.077509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:36.087050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:36.088478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8af66a-65e7-4cd0-8573-622ef12a9289 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:36.097601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 744/1477] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:38.259414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ae47-f22e-4e81-ae43-da602509eb6a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.260000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ae47-f22e-4e81-ae43-da602509eb6a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.260000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713ae47-f22e-4e81-ae43-da602509eb6a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.261759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 734/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:38.268921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7167f-69c3-48e6-ba9a-29457d3e1958 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.269379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7167f-69c3-48e6-ba9a-29457d3e1958 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.269626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7167f-69c3-48e6-ba9a-29457d3e1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.288002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-14a7167f-69c3-48e6-ba9a-29457d3e1958 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:38.289216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-14a7167f-69c3-48e6-ba9a-29457d3e1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:38.297160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 745/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:38.348095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7f94-2a88-443c-95c9-f0b2505142a4 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.348379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7f94-2a88-443c-95c9-f0b2505142a4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.348663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7f94-2a88-443c-95c9-f0b2505142a4 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.350481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 735/1480] 10.222.0.77 () {54 vars in 962 bytes} [Fri Jan 28 01:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:38.355579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796d39-d921-47d5-a487-fec67338be95 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.355875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796d39-d921-47d5-a487-fec67338be95 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.356156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796d39-d921-47d5-a487-fec67338be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.374856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9f796d39-d921-47d5-a487-fec67338be95 None None] MFA Rules not processed for user `f0df50dd209d43f2b2b51267672145f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:38.376040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9f796d39-d921-47d5-a487-fec67338be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:38.382422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 746/1481] 10.222.0.77 () {58 vars in 1059 bytes} [Fri Jan 28 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:38.390295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7f94-2a88-443c-95c9-f0b2505142a4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:38.400505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7f94-2a88-443c-95c9-f0b2505142a4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:38.404013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:38.404633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.404918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.405198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.414343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:38.415752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b777-94db-427a-b903-6648befc17ab service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:38.425379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 736/1482] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:11.833675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df820e-eef0-4f20-83b6-7527ef42815f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:11.834561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df820e-eef0-4f20-83b6-7527ef42815f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:11.834561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df820e-eef0-4f20-83b6-7527ef42815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:11.850695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba386-f3a7-49ea-bcc2-f21108861764 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:11.851266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba386-f3a7-49ea-bcc2-f21108861764 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:11.851467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba386-f3a7-49ea-bcc2-f21108861764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:11.858838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a7df820e-eef0-4f20-83b6-7527ef42815f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:11.860029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a7df820e-eef0-4f20-83b6-7527ef42815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:11.877444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 747/1483] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:11.903389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:11.903763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:11.904213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:11.907331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5f3ba386-f3a7-49ea-bcc2-f21108861764 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:11.908967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5f3ba386-f3a7-49ea-bcc2-f21108861764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:11.927710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 737/1484] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:11.945039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:11.950554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:11.950840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a565c-1147-44ea-bc6d-a57142f90f27 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:11.951346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a565c-1147-44ea-bc6d-a57142f90f27 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:11.951870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a565c-1147-44ea-bc6d-a57142f90f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:11.968543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 748/1485] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:11.982260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.004327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db67737-4550-4daf-a47d-ee238a08825d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.009688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b72a565c-1147-44ea-bc6d-a57142f90f27 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.010901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b72a565c-1147-44ea-bc6d-a57142f90f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.017472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.018187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.018464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.018746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.020421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.020737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.024904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.034056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 738/1486] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:12.035274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.035572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.035838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.061783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 749/1487] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.062665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.078867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.080070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.082701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b6ea-f726-4d7c-88b5-7ebc2ef6e944 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.092529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 739/1488] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.093285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.094146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.095377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.095644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.095926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.096647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.097286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.099085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4af11f-c2f5-46ea-ae8d-610718f5d706 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.116486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d83c1-ee8d-40ef-ad24-583027d6113a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.121149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.121839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.122115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.122377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.123059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.124953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.129793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 750/1489] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.129793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409863c-b750-4ef9-94b8-55b92577c18d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.129793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409863c-b750-4ef9-94b8-55b92577c18d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.129793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409863c-b750-4ef9-94b8-55b92577c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.173552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8409863c-b750-4ef9-94b8-55b92577c18d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.174924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8409863c-b750-4ef9-94b8-55b92577c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.187429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 740/1490] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.188666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.189149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 751/1491] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.190440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd78eb-c77d-49f4-aaf5-456146648f74 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.190883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd78eb-c77d-49f4-aaf5-456146648f74 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.191166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd78eb-c77d-49f4-aaf5-456146648f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.208618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6bcd78eb-c77d-49f4-aaf5-456146648f74 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.209816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6bcd78eb-c77d-49f4-aaf5-456146648f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.251740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72662548-020a-4e70-a35d-d0504fb47aa6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.256338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.256994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.257284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.257561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.258284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.260175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6de71-9722-40c8-a833-88d345077649 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.268281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 752/1492] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.269547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04aab-a7c0-40db-97b8-7323387f49f1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.270129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04aab-a7c0-40db-97b8-7323387f49f1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.270129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04aab-a7c0-40db-97b8-7323387f49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.288914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9ec04aab-a7c0-40db-97b8-7323387f49f1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.290091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9ec04aab-a7c0-40db-97b8-7323387f49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.292248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 741/1493] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.293429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3ff8-1981-4677-92e1-86aa1c1570ea None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.293816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3ff8-1981-4677-92e1-86aa1c1570ea None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.294170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb3ff8-1981-4677-92e1-86aa1c1570ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.315094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4ccb3ff8-1981-4677-92e1-86aa1c1570ea None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.316305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4ccb3ff8-1981-4677-92e1-86aa1c1570ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.350829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 753/1494] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.352254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.352637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.353009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.370594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.371873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 742/1495] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.372047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.373164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.373459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.373738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.384649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 754/1496] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.385740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.391726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.392894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.399394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3f9b-6a10-4b6c-b74a-bf334503d67b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.400754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 743/1497] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.402575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.404267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.405000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.405363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.405723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.406504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.408985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca6997-0539-435f-b65a-8ff27babc32d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.412939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019267ed-e34a-4cc9-bdb8-edfedce984db None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.417435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.418117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.418404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.418705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.419391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.419725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.421656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.431320 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 755/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.432419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63c85-04b4-45c5-a45c-a9c3e1429ab5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.432784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63c85-04b4-45c5-a45c-a9c3e1429ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.432982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63c85-04b4-45c5-a45c-a9c3e1429ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.435563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 744/1499] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.436316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.450405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29590f2-5845-43b0-8a5b-599371ee6018 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.455532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.456173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.456454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.456733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.457096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8bd63c85-04b4-45c5-a45c-a9c3e1429ab5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.457403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.458318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8bd63c85-04b4-45c5-a45c-a9c3e1429ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.459322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcb75-40b8-445d-b2f4-d22a23db6982 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.466257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 756/1500] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.467281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66f8f-ce63-4922-b0d1-dc3ac5c38c58 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.467568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66f8f-ce63-4922-b0d1-dc3ac5c38c58 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.467853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c66f8f-ce63-4922-b0d1-dc3ac5c38c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.484839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 745/1501] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.484839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e67d6-b334-4f40-b969-18197cf3dc53 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.484839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e67d6-b334-4f40-b969-18197cf3dc53 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.484839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e67d6-b334-4f40-b969-18197cf3dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.486576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-88c66f8f-ce63-4922-b0d1-dc3ac5c38c58 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.487759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-88c66f8f-ce63-4922-b0d1-dc3ac5c38c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.496008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 757/1502] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.497241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.497528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.497846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.502063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-892e67d6-b334-4f40-b969-18197cf3dc53 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.503263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-892e67d6-b334-4f40-b969-18197cf3dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.514737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 746/1503] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.514737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.514737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.514737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.515274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.515856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.524079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 758/1504] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.524836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.531683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:12.533451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:12.534398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c45d8-c70a-4789-8089-fb974d0a4806 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.538825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.539520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.539749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.540024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.540730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.541242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 747/1505] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:12.544897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.544999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.551535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79200-a3a3-4be6-8b11-040b4beb27a4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.552335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 759/1506] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:12.552885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.556474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.557119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.557400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.557676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.558408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.560547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.562076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d401fd-12da-41e3-9208-38d1ab3c2b84 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.566561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.567189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.567474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.567755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.568453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.568765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.570349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.582840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 760/1507] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.589045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 748/1508] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.589045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.590695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.601016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf21c-35c6-4786-9ea4-e18f0c991d30 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.646995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e080c3a-c412-4fa8-bc53-9f547ff82b6e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.651675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.652338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.652622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.652722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.652901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.653319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.653600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.653707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.653909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.654618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.654918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.655256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.656507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.665362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 749/1509] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:12.666286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.667811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 761/1510] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.668802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.676137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741e851-ad0e-4bd4-b8d0-0f5fb6d5c862 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.680151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b5ce-b70d-4c6e-b3fb-0fef837c7149 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.680853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.681498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.681806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.682086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.682802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.683115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.684681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.684967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.685905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.686193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.686472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.687204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.687539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.689106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.696057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 750/1511] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.696847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.705787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 762/1512] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.706469 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f33b2-fc3f-4241-8e0e-faa6d34eef71 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.710877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.711077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.711717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.712001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.712278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.712980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:12.713288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.714903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.720750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd81eb-16d8-48f6-8f04-199ee52ad290 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.725243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.725932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.726218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.726496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.733550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 751/1513] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:12.733723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.733858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.733955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.736676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c43cd-673a-4628-9e24-2c560699f297 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.738621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 763/1514] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:12.739219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.742299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.742969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.743248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.743572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.744254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.746204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.748318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a92fa-09da-4d00-8100-bd4ba918777e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.752818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.753446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.753729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.754039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.754707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.757109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.767205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 752/1515] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/users => generated 278 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.768038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.779402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdb855-2a88-4664-8907-297c75318440 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.787875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 764/1516] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.788046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.788180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.788285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.788285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.788285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.788285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.789021 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.801939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 753/1517] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:12.801939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.808886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea080f-28a9-406b-a265-ad1ea146e457 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.845991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c0ac-7358-4c91-be4d-39e2c0c4b3fe admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.850727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.851425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.851708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.851983 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.852671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.854600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.863430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.864091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.864378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.864657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.865340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.867298 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.881286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 765/1518] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.882106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.895347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 754/1519] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.896380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.943567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae314e-4c54-4680-abe3-80cbf7767207 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.954708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ec573-96ee-4bc0-ae57-ef533a1a9600 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:12.959333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.959989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.960273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.960553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.961237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:12.963163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:12.988429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 755/1520] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:12.989267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:12.996439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:12.997114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:12.997397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:12.997676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:12.998391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.000296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.028873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 766/1521] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:12 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.028873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.050650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945e290-27d8-4e39-96d4-c2ee9de93676 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.084366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4dff-3ad8-4deb-aaef-46cd7dcbb950 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.088903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.089563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.089891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.090168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.090881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.092462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.102738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 767/1522] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.103613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.106942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.107836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.108127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.108404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] PATH_INFO: `/v3/projects/a830c3a19c3740619ece0b4ca820490e/users/a7dc50f676f942319f779d8f141502f4/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.112723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130178-aef2-4677-a47b-34ac174acb1d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.117280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.117939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.118224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.118501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.119164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.121008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.122249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a830c3a19c3740619ece0b4ca820490e, user_id=a7dc50f676f942319f779d8f141502f4, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.124922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.138832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 756/1523] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:12 2022] PUT /identity/v3/projects/a830c3a19c3740619ece0b4ca820490e/users/a7dc50f676f942319f779d8f141502f4/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.143051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.143176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 768/1524] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/users => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.143176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.153561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212f72c-e6ad-4622-90e2-8ff064897f5f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.203648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedef45-f0c3-43ce-b982-a8a79f6913d5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.207770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.208230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.208451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.208733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.209008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.209129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.209365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.209639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] PATH_INFO: `/v3/projects/6639261ee8ee46e0a4e3a01eb63b9ab4/users/9717e2ab2be74631aba4b196112bf984/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.209779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.211589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.223749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6639261ee8ee46e0a4e3a01eb63b9ab4, user_id=9717e2ab2be74631aba4b196112bf984, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.226548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.232868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 769/1525] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.233649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.245971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 757/1526] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/6639261ee8ee46e0a4e3a01eb63b9ab4/users/9717e2ab2be74631aba4b196112bf984/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.245971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.246245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6627-3072-43e7-b1b8-2a50bef1a1dc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.298494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.299178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.299467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.299751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.300440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.302386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.303179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b868d5-df67-4893-b2f6-dc11dcae6240 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.308061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.308865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.309176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.309451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.310178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.312568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.323761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 770/1527] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.324903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.333313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 758/1528] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.334227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.336711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a8fe-2c44-47d0-a5d1-6301d2a0b3a0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.341712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.342482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.342770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.343048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.343729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.345374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d651511-fb6a-4bd5-b1f9-434da3ab86e9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.345676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.350177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.350820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.351101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.351375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.352217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.353638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10fcdc-f877-4be8-b7e2-4fa729a30ffd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.364472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 759/1529] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.365859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.366276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.366415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 771/1530] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:13.366560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.367614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.378001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7291d-ec89-4fa8-a0e4-e7ecfe251518 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.382932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.383592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.383879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.384159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.384794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:13.384914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.386022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:13.386503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd31a-dafd-4459-bdc8-9dbd2d70949e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.394237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 760/1531] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:13.395249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.397492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 772/1532] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.398780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.399067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.399344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.405546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313c2cf-b1d5-4ed0-be06-4a30a408392a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.410285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.410941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.411222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.411820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.412441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.414063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.415973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:13.417167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:13.427325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 761/1533] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.427325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.427568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 773/1534] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:13.427568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.437839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44061f-48a3-4625-8a6b-eb92eff28e59 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.438010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac1c0b-4954-460c-81d9-1e92d4e5eb16 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.443213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.443375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.443895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.443994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.444194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.444323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.444476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.444596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.445182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.445292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.446780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.446893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.456446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 774/1535] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.459697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 762/1536] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.459843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.459940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.467592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d283b-e95e-4bac-99e1-b73d5a3409de admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.468392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36e56f-dd64-4dbe-8ed8-c118aa20cf47 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.472122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.472755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.472935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.473094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.473303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.473820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.474033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.474228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.474512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] PATH_INFO: `/v3/projects/cd7ff02f46e3402da0453aee92830397/users/4be475a69151423086bdd40b1a9a8c23/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.475582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.486454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 763/1537] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.487531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.488846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7ff02f46e3402da0453aee92830397, user_id=4be475a69151423086bdd40b1a9a8c23, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.491496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.498352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c954bb-2f03-414d-b94d-36d92960bb86 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.505587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 775/1538] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/cd7ff02f46e3402da0453aee92830397/users/4be475a69151423086bdd40b1a9a8c23/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.506574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.560564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.561249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.561534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.561848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.562582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.564251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c67d-66f8-4a6f-8931-620ad4cbe6bc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.564405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.570892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.571555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.571838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.572119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.574546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 764/1539] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.575286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.583590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.585108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.585254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018e9c0-8cf1-490c-ba19-6d09ed496562 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.590023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.590594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.590879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.591164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.591921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.593493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.595515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 776/1540] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:13.598677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.607786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 765/1541] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.607786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.608017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d699-da9e-4078-9450-491303e1a0e4 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.611891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.612541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.612831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.613113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.616591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c64b9-d3a4-4214-9bd2-19a570196cd9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.622442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.622799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.623300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.623610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.624141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.624270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.625029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.626875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.634284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 777/1542] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:13.635042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.641962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 766/1543] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.641962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.644829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ece9a-595c-400c-b0f8-b50f2ba355fb service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.649969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.650632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.650913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.651188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.651299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101143e-bfa7-4443-b2c4-d37b396f0d5d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.651951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.653470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a33c5-2cd9-48f5-ab81-3818334b6b6e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.656280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.657453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.657785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.658059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.658777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.660367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.664048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 778/1544] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.665317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.665608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.665911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.677904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 767/1545] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:13.677904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.689367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903806c0-5d58-4e6f-b083-e996e846896e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.693600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] MFA Rules not processed for user `4be475a69151423086bdd40b1a9a8c23`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:13.694790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.694959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:13.695875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.696320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.696821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] PATH_INFO: `/v3/projects/e903984909674521a44fe37d95d94b8c/users/3bf94c1b148942939821bdd801d4f907/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.713291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e903984909674521a44fe37d95d94b8c, user_id=3bf94c1b148942939821bdd801d4f907, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.716349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.736897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 768/1546] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/e903984909674521a44fe37d95d94b8c/users/3bf94c1b148942939821bdd801d4f907/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.736897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.763886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 779/1547] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3375 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:13.766611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.778092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf143eb-5b68-4ae2-963e-7a9f8f70b0fd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.806031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad664231-9600-49fb-87b5-bc87af4de051 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:13.811198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.812187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.812384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.812693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] PATH_INFO: `/v3/projects/dd02e7febf1b4e4f905b571ac25ce7f5/users/e1b2342ab228478bb22fd1e10e34bc3b/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.827627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd02e7febf1b4e4f905b571ac25ce7f5, user_id=e1b2342ab228478bb22fd1e10e34bc3b, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.830742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.838738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:13.840411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:13.841074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:13.841547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] PATH_INFO: `/v3/projects/578fc5bd64da4dcdbff2e317361168ec/users/264a23388dc64b269325ae52eb4130de/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:13.853980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 769/1548] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/dd02e7febf1b4e4f905b571ac25ce7f5/users/e1b2342ab228478bb22fd1e10e34bc3b/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.853980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.870866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578fc5bd64da4dcdbff2e317361168ec, user_id=264a23388dc64b269325ae52eb4130de, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:13.875313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:13.925957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 780/1549] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/578fc5bd64da4dcdbff2e317361168ec/users/264a23388dc64b269325ae52eb4130de/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:13.928897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:13.938480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5b4f-d0db-4a71-b921-4e5b2ab22045 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.006538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef2292-ebe6-4acf-8335-ffafb7feaab4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.010984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.012312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.012658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.013165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] PATH_INFO: `/v3/projects/bfedf965e926458dbf845176b89fc000/users/1d1d004d529b4283b6f1910981426c0e/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.014253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.015684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.016171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.017134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] PATH_INFO: `/v3/projects/352100bf8a044c2681a5fdf2303fc567/users/f99db570ff064b06b95babd208d27f4f/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.033194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfedf965e926458dbf845176b89fc000, user_id=1d1d004d529b4283b6f1910981426c0e, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.036135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0893c-c94e-4f73-9dfb-af47a715dfd7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.050796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352100bf8a044c2681a5fdf2303fc567, user_id=f99db570ff064b06b95babd208d27f4f, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.053905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.066448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 770/1550] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/bfedf965e926458dbf845176b89fc000/users/1d1d004d529b4283b6f1910981426c0e/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:14.071159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b722-b8f7-40b1-bbee-6934d8362fe0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.071666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b722-b8f7-40b1-bbee-6934d8362fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.072052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b722-b8f7-40b1-bbee-6934d8362fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.102428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 781/1551] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:13 2022] PUT /identity/v3/projects/352100bf8a044c2681a5fdf2303fc567/users/f99db570ff064b06b95babd208d27f4f/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:14.103475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.118563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6e74b722-b8f7-40b1-bbee-6934d8362fe0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.119966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6e74b722-b8f7-40b1-bbee-6934d8362fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.200246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fee658-1563-44f9-9846-f21c5f9d0985 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.202109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 771/1552] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:14.204631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1639a3-a3d3-44b0-b537-c904a39f707d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.205176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1639a3-a3d3-44b0-b537-c904a39f707d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.205695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1639a3-a3d3-44b0-b537-c904a39f707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.206639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.207475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.207844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.208701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.209106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.211194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cd89e-8fe1-4bf2-bdc3-3188577047ec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.244837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ac1639a3-a3d3-44b0-b537-c904a39f707d None None] MFA Rules not processed for user `e1b2342ab228478bb22fd1e10e34bc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.245958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 782/1553] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/projects => generated 353 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:14.246802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ac1639a3-a3d3-44b0-b537-c904a39f707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.247819 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2cd0-8be8-4efc-8b49-ea99b2b04864 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.248344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2cd0-8be8-4efc-8b49-ea99b2b04864 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.248862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2cd0-8be8-4efc-8b49-ea99b2b04864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.280545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ccbb2cd0-8be8-4efc-8b49-ea99b2b04864 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.283849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ccbb2cd0-8be8-4efc-8b49-ea99b2b04864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.337779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 772/1554] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:14.339074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.339432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.339785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.362331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 783/1555] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:14.365457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.365457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.365678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.365827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.376556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.389026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 773/1556] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:14.392776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.396955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] MFA Rules not processed for user `1d1d004d529b4283b6f1910981426c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.398493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.491149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 784/1557] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:14.492154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.504220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f2540-3f93-4848-9d05-0311eecd8bc5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.510161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.510860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.511139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.511371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf01fc7-d1c7-4c24-9ae1-ee1eb0461835 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.511482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.519290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.520916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.521217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.521543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.522803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.526695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.537625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.542093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.557978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 785/1558] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/users => generated 283 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:14.559090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.570251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 774/1559] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:14.571035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.571979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cc6f4-46c9-4bb4-89be-d42e18e56d37 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.578255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.579802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.580145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.580432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.581310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.583592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.590444 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acf84f-5f7c-4b8e-a68a-19b500b6f0e0 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.600142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.600819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.601101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.601371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.618223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 786/1560] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:14.619686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.627996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.630959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.653157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 775/1561] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:14.663277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.682728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb928-bd9e-45a9-b58d-90012acc22cb service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.689590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243f51-54bd-4ff2-917f-873d97ce0329 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.694547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.695226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.695517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.695802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.793018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.793990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.794282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.794583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.795307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.801186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112f10-00e5-4d4b-9495-c75bbbfdfc5a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.806006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.808565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.820971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 787/1562] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:14.822096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.833354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ba05-9c42-4046-b55d-2e6042689f88 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.840970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.842618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.843111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.843581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.845254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.847367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.863164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 788/1563] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:14.864184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:14.879679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 776/1564] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:14.879679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.879679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.879679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.882737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1dd0e-280e-40d9-ad78-94dda034821f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:14.909699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] MFA Rules not processed for user `9717e2ab2be74631aba4b196112bf984`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:14.911074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:14.958287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:14.959094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:14.959556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:14.959930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:14.960941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:14.962985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:14.991502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 789/1565] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:14.992535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.010255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cfb89-d13b-49c3-a81e-7063fa695de9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.016292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.017601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.019102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.019552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] PATH_INFO: `/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad/users/0fdd5fa4506f4916ab23257659798cc1/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.037003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 777/1566] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:15.038534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.054162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75afe32b4e194f5db4dbc8f1b3081cad, user_id=0fdd5fa4506f4916ab23257659798cc1, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.059637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6952f-98ec-4b41-9ea0-37bd44d64089 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.061960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.067686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.068666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.069221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.069554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.070443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.072641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd211d-ecbd-4721-b272-f7d328c4dd85 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.085792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 790/1567] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:14 2022] PUT /identity/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad/users/0fdd5fa4506f4916ab23257659798cc1/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:15.085792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.101774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 778/1568] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:15 2022] POST /identity/v3/users => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:15.101774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.101774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.101774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.122669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] MFA Rules not processed for user `9717e2ab2be74631aba4b196112bf984`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:15.123982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:15.160442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7d3b8-343f-47a9-9ca2-bf166c425284 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.165938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.166745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.167693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.168075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.169651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.172157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.185619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 779/1569] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:15.186449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.200420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 791/1570] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:15.204522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.205493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e11d-46f3-4e7e-82f7-be42cc730031 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.211085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.212228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.212544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.212891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.213995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.215914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.219335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b71e7-929f-49c7-b40e-5342f6399fa9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.224794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.225911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.225911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.226122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.229930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 780/1571] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:15.230070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.230151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.230432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b9457-f4d7-4b4c-9439-32694da52455 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.240617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2a72-dd7d-43b6-9af9-97b48d52c5c3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.244918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 792/1572] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:15.244918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0789c-7d55-4a55-8be2-10cda5cb3f13 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.244918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0789c-7d55-4a55-8be2-10cda5cb3f13 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.245254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0789c-7d55-4a55-8be2-10cda5cb3f13 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.247733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 793/1573] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 02:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:15.248444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0789c-7d55-4a55-8be2-10cda5cb3f13 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.253329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.254789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.255039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.255381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] PATH_INFO: `/v3/projects/a541aaac57d74d9b9587b6e19af84f39/users/5cea439cf0d0431bb10890cf223bf23a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.267284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0789c-7d55-4a55-8be2-10cda5cb3f13 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.277507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.279494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.279494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.279494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] PATH_INFO: `/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad/users/0fdd5fa4506f4916ab23257659798cc1/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.280626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a541aaac57d74d9b9587b6e19af84f39, user_id=5cea439cf0d0431bb10890cf223bf23a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.283351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75afe32b4e194f5db4dbc8f1b3081cad, user_id=0fdd5fa4506f4916ab23257659798cc1, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.287182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.295774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd0b2a-1e98-4e4c-a115-c70ef07e3ad9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.300986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 794/1574] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:15 2022] PUT /identity/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad/users/0fdd5fa4506f4916ab23257659798cc1/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:15.302121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.319926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 781/1575] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:15 2022] PUT /identity/v3/projects/a541aaac57d74d9b9587b6e19af84f39/users/5cea439cf0d0431bb10890cf223bf23a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:15.322822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208764f-4fac-4341-b215-aeef10a7af45 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.322822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208764f-4fac-4341-b215-aeef10a7af45 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.322822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208764f-4fac-4341-b215-aeef10a7af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.339497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a208764f-4fac-4341-b215-aeef10a7af45 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:15.340743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a208764f-4fac-4341-b215-aeef10a7af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:15.382989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299caf7a-d44d-4a63-bd07-fa2abeb7ffc9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.411601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 782/1576] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:15.413219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.413574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.413884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.443285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.443820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] MFA Rules not processed for user `0fdd5fa4506f4916ab23257659798cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:15.444629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.445219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.445322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:15.445530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] PATH_INFO: `/v3/projects/7283e28ce75a459ebc56e88e03f56f76/users/f7dffc229dac4320b0acce8359807809/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.461572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283e28ce75a459ebc56e88e03f56f76, user_id=f7dffc229dac4320b0acce8359807809, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.464407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.479163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 795/1577] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:15 2022] PUT /identity/v3/projects/7283e28ce75a459ebc56e88e03f56f76/users/f7dffc229dac4320b0acce8359807809/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:15.480609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.519313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 783/1578] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3440 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:15.520610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.537784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2626a6-62c7-4d25-9b5d-ec389985afc3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.551175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db19d-1e6a-4815-9892-85e31ecec9b8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.556569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.557249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.557533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.557837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.558561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.560158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.576160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 796/1579] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:15.576160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.589114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d088c2e-1d4d-4af4-83a0-b24e2c0649cb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.595716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.596455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.596722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.597023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.598353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.600256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.614477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 797/1580] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:15.614477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.619716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.620467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.621003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.621356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.682139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e460db2-09c4-45aa-9b37-ad09ea4880e2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.687742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.688625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.689034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.689448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.705230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.707175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.721998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 784/1581] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:15.722943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.733939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90212-5741-4f6f-b51b-bb02821197c0 service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.740734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.741897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.742242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.742529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] PATH_INFO: `/v3/projects/a541aaac57d74d9b9587b6e19af84f39/users/5cea439cf0d0431bb10890cf223bf23a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.744987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a541aaac57d74d9b9587b6e19af84f39, user_id=5cea439cf0d0431bb10890cf223bf23a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.748699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.771753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 785/1582] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:15 2022] PUT /identity/v3/projects/a541aaac57d74d9b9587b6e19af84f39/users/5cea439cf0d0431bb10890cf223bf23a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:15.771753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:15.838899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:15.841011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3c611-2942-4d99-90fa-23be0f0839a5 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:15.853563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 798/1583] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:15 2022] GET /identity/v3/auth/tokens => generated 3440 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:15.867488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7f23-4891-46c8-a697-6524aad592e6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.869566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7f23-4891-46c8-a697-6524aad592e6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.871334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce7f23-4891-46c8-a697-6524aad592e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.936540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f7ce7f23-4891-46c8-a697-6524aad592e6 None None] MFA Rules not processed for user `5cea439cf0d0431bb10890cf223bf23a`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:15.937922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f7ce7f23-4891-46c8-a697-6524aad592e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:15.980637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ef61-792d-485e-a0b6-77a4ab63941d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:15.993344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:15.994558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:15.994676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:15.996076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] PATH_INFO: `/v3/projects/7283e28ce75a459ebc56e88e03f56f76/users/f7dffc229dac4320b0acce8359807809/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:15.999651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283e28ce75a459ebc56e88e03f56f76, user_id=f7dffc229dac4320b0acce8359807809, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:16.007561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:16.048052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 786/1584] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:15 2022] PUT /identity/v3/projects/7283e28ce75a459ebc56e88e03f56f76/users/f7dffc229dac4320b0acce8359807809/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:16.048052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:16.051261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 799/1585] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:16.062283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.062573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.063051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.093825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] MFA Rules not processed for user `f7dffc229dac4320b0acce8359807809`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:16.095215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:16.173890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fafae-0a52-4bba-91f6-c221458cef16 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:16.186379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 800/1586] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:16.186379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:16.190523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:16.191428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.191709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.191982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.206716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281209b-4231-4eea-b61f-4cc700146ed6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:16.217214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:16.218185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.218500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.218911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.323403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:16.325451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c7de7-07d5-49f2-b651-48d4b90f3616 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:16.337240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 787/1587] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:16 2022] GET /identity/v3/auth/tokens => generated 3375 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:16.339454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2560d2-3c00-4627-894f-725dc96b3915 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.339454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2560d2-3c00-4627-894f-725dc96b3915 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.339772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2560d2-3c00-4627-894f-725dc96b3915 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.342064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 788/1588] 10.222.0.77 () {54 vars in 912 bytes} [Fri Jan 28 02:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:16.349384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.352201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.352560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.378142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:16.379552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:16.382333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:16.383790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:16.413371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 801/1589] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:16 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:16.532582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 789/1590] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:16.546267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:16.548074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:16.679082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd015557-c98d-4732-970f-5cc43ec33a54 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:16.685945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:16.699836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c269f6c-a7a2-4971-a3ed-1a9a14a811ef None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:16.702764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:16.706061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.706449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.707267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.711007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:16.712430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.714704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.716317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.747754 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:16.750438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29130b04-4caa-4ced-8e02-13a16701811c service glance] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:16.754973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:16.758921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:16.784152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 802/1591] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:16 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:16.812033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 790/1592] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:16 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:16.880900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:16.881228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:16.881779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:16.919517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] MFA Rules not processed for user `f99db570ff064b06b95babd208d27f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:16.921206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:17.035042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.037166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 803/1593] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:17.170779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ac88d-7469-4eb1-bba6-a42b23532a22 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.184454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.185135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.185680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.185986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.186925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.190390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.280421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 791/1594] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:17 2022] POST /identity/v3/projects => generated 403 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:17.282759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.299531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7d25a-90c6-44ec-9466-8e2c823fe9d6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.449550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.451199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.451641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.452938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.455349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.459046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.507114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 804/1595] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:17 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:17.511235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.525610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6559-5a2f-475f-b8d0-5d7369bfe0af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.537507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.538265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.538510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.538800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.539535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.548401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.589462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.591936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 792/1596] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:17.604046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d7928-207f-4a98-b669-fc8ed001dc91 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.613077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.614043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.614331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.614611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] PATH_INFO: `/v3/projects/dc7763d633c84178a5d77cb41251f5a3/users/ec18edd7164848c2adc20274ee14fe25/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.641249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7763d633c84178a5d77cb41251f5a3, user_id=ec18edd7164848c2adc20274ee14fe25, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.644713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.671560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 805/1597] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:17 2022] PUT /identity/v3/projects/dc7763d633c84178a5d77cb41251f5a3/users/ec18edd7164848c2adc20274ee14fe25/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:17.675088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.691922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddfb47-811f-43ab-8e33-e8e254fdd10e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.767331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.768757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.769462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.770247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.771312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.773876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742e96a-998b-46ac-a77e-44883f28bf31 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.793821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:17.804965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 793/1598] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:17.807393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a51078-fa8f-458b-b791-4f65075bd7c9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:17.825789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:17.827102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.827893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.829726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] PATH_INFO: `/v3/projects/dc7763d633c84178a5d77cb41251f5a3/users/ec18edd7164848c2adc20274ee14fe25/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.832171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7763d633c84178a5d77cb41251f5a3, user_id=ec18edd7164848c2adc20274ee14fe25, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:17.835399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014358f-cdd8-48fd-819d-8dd3ec6b83a2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:17.854272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 806/1599] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:17 2022] PUT /identity/v3/projects/dc7763d633c84178a5d77cb41251f5a3/users/ec18edd7164848c2adc20274ee14fe25/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:17.892106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c82-a76b-420e-b525-192ef1e42f29 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.892611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c82-a76b-420e-b525-192ef1e42f29 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.893625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c82-a76b-420e-b525-192ef1e42f29 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.897000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 794/1600] 10.222.0.77 () {54 vars in 912 bytes} [Fri Jan 28 02:01:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:17.903700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bf3b2-dfb0-4e67-a57c-8b542c70687b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:17.904113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bf3b2-dfb0-4e67-a57c-8b542c70687b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:17.904401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bf3b2-dfb0-4e67-a57c-8b542c70687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:17.962861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-471bf3b2-dfb0-4e67-a57c-8b542c70687b None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:17.964918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-471bf3b2-dfb0-4e67-a57c-8b542c70687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:18.033770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 807/1601] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:01:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:18.094956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059c82-a76b-420e-b525-192ef1e42f29 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:18.112219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059c82-a76b-420e-b525-192ef1e42f29 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:18.122865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:18.123982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.124493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.125046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.137058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:18.139376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef35ad3-af7c-4a49-be22-b6a50737ff4f service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:18.139525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6760-f6b5-4f45-a8a0-fcf8451c3324 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.139981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6760-f6b5-4f45-a8a0-fcf8451c3324 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.140248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6760-f6b5-4f45-a8a0-fcf8451c3324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.171174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d06c6760-f6b5-4f45-a8a0-fcf8451c3324 None None] MFA Rules not processed for user `3bf94c1b148942939821bdd801d4f907`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:18.174842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d06c6760-f6b5-4f45-a8a0-fcf8451c3324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:18.178373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 795/1602] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:18.279542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 808/1603] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:18 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:18.291015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40249-6e7c-4aa4-8695-8a951e88bf85 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.292076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40249-6e7c-4aa4-8695-8a951e88bf85 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.292375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40249-6e7c-4aa4-8695-8a951e88bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.318302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0ab40249-6e7c-4aa4-8695-8a951e88bf85 None None] MFA Rules not processed for user `3bf94c1b148942939821bdd801d4f907`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:18.320045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0ab40249-6e7c-4aa4-8695-8a951e88bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:18.334394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 796/1604] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:18 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:18.352323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65eeb0-1fbc-4d0e-8d1a-4ac54b9df563 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.352742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65eeb0-1fbc-4d0e-8d1a-4ac54b9df563 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.353123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65eeb0-1fbc-4d0e-8d1a-4ac54b9df563 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.355388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 809/1605] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 02:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:18.362882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d830a7-5954-4ee0-82c9-7c571be872d6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.363186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d830a7-5954-4ee0-82c9-7c571be872d6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.363499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d830a7-5954-4ee0-82c9-7c571be872d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.396501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-09d830a7-5954-4ee0-82c9-7c571be872d6 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:18.398038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-09d830a7-5954-4ee0-82c9-7c571be872d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:18.551709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 797/1606] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 02:01:18 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:18.566687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65eeb0-1fbc-4d0e-8d1a-4ac54b9df563 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:18.592147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65eeb0-1fbc-4d0e-8d1a-4ac54b9df563 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:18.599636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:18.600403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:18.601424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:18.601424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:18.629801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:18.631756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e03b6-888a-4b40-ab86-acc68ca46471 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:18.661442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 810/1607] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:18 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:19.219932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.220504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.220504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.222318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 798/1608] 10.222.0.77 () {54 vars in 912 bytes} [Fri Jan 28 02:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:19.229155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c62b3-3536-4072-8c90-3b3972779998 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.229667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c62b3-3536-4072-8c90-3b3972779998 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.229906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c62b3-3536-4072-8c90-3b3972779998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.298773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3c8c62b3-3536-4072-8c90-3b3972779998 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:19.302445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3c8c62b3-3536-4072-8c90-3b3972779998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:19.343405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 811/1609] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:01:19 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:19.370957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:19.375180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9727-b49d-46a8-a75f-10469c3b42f5 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9727-b49d-46a8-a75f-10469c3b42f5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9727-b49d-46a8-a75f-10469c3b42f5 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 812/1610] 10.222.0.77 () {54 vars in 960 bytes} [Fri Jan 28 02:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba482b-469d-419b-b54e-fca7f09db5c0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.508759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba482b-469d-419b-b54e-fca7f09db5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.509850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba482b-469d-419b-b54e-fca7f09db5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.551719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-64ba482b-469d-419b-b54e-fca7f09db5c0 None None] MFA Rules not processed for user `5ba03c4dbf5c4232842c40b782e30021`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:19.556912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-64ba482b-469d-419b-b54e-fca7f09db5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:19.611799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809ef83-a5c9-4605-9bde-2c96c6288f71 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:19.632290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:19.632983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.633272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.633555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.681979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:19.687721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:19.735933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 799/1611] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:19.752003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 813/1612] 10.222.0.77 () {58 vars in 1057 bytes} [Fri Jan 28 02:01:19 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:19.760943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:19.780716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fac07-7a87-4b39-812f-7a73bca79c8f service glance] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:19.797807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:19.798639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:19.799402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:19.799402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:19.802636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:19.827807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:19.834326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265a027-0864-4f47-abdb-1e228d28635b service placement] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:19.861485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 800/1613] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:20.399944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981b65-159f-4cce-a524-58c68e26ad95 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:20.400846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981b65-159f-4cce-a524-58c68e26ad95 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:20.401868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5981b65-159f-4cce-a524-58c68e26ad95 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:20.408974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 814/1614] 10.222.0.77 () {54 vars in 912 bytes} [Fri Jan 28 02:01:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:20.418480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f00-2b2a-44a9-9774-731d3de88efe None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:20.420076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f00-2b2a-44a9-9774-731d3de88efe None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:20.421142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f00-2b2a-44a9-9774-731d3de88efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:20.467725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-99df9f00-2b2a-44a9-9774-731d3de88efe None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:20.470333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-99df9f00-2b2a-44a9-9774-731d3de88efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:20.484530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5981b65-159f-4cce-a524-58c68e26ad95 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:20.511276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 801/1615] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:01:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:20.566071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:20.566690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:20.567186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:20.639362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] MFA Rules not processed for user `ec18edd7164848c2adc20274ee14fe25`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:20.642638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:20.709468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5981b65-159f-4cce-a524-58c68e26ad95 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:20.723380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:20.726929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:20.727495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:20.727944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] PATH_INFO: `/v3/users/1d1d004d529b4283b6f1910981426c0e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:20.730643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1d004d529b4283b6f1910981426c0e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:20.733995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: WARNING py.warnings [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:20.733995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: warnings.warn(msg) Jan 28 02:01:20.733995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: Jan 28 02:01:20.743751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:20.876528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 802/1616] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:20 2022] POST /identity/v3/auth/tokens => generated 3490 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:20.879762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:20.925049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42005bf3-0628-4455-98e2-ebc74f20af73 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:20.938111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:20.941310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:20.944554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:20.945667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:20.975807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:20.978980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1d004d529b4283b6f1910981426c0e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:20.980612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc5b2c-963e-4463-9ff2-7ec509012a99 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:20.982028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1d004d529b4283b6f1910981426c0e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:20.983459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1d004d529b4283b6f1910981426c0e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:21.002459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 803/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:21.012817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1d004d529b4283b6f1910981426c0e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:21.046050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1d004d529b4283b6f1910981426c0e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:21.130972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 815/1618] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:20 2022] DELETE /identity/v3/users/1d1d004d529b4283b6f1910981426c0e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:21.135577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:21.135945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:21.136303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:21.175553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:21.176678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:21.298778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 804/1619] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:21 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:21.321038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:21.322738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:21.429609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fea6da-af04-42c4-8fd3-1aedc13295a6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:21.440066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:21.441497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:21.442149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:21.442614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:21.467399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:21.471358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:21.495764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 816/1620] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:22.957713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:22.959323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:22.992177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e20a6-6c71-41de-9838-162c4137c9cd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:23.007242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:23.008721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:23.010250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:23.010719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] PATH_INFO: `/v3/projects/bfedf965e926458dbf845176b89fc000` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:23.023512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfedf965e926458dbf845176b89fc000)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:23.025803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: WARNING py.warnings [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:01:23.025803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: warnings.warn(msg) Jan 28 02:01:23.025803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: Jan 28 02:01:23.027560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:23.160992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfedf965e926458dbf845176b89fc000', 'request_id': 'req-ed76f96a-345a-4929-af4b-1069910fad27'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.179072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfedf965e926458dbf845176b89fc000', 'request_id': 'req-ed76f96a-345a-4929-af4b-1069910fad27'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.195736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfedf965e926458dbf845176b89fc000', 'request_id': 'req-ed76f96a-345a-4929-af4b-1069910fad27'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.224907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] The token cache is being invalidate because project bfedf965e926458dbf845176b89fc000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:23.225222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.226445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.230909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 805/1621] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:22 2022] DELETE /identity/v3/projects/bfedf965e926458dbf845176b89fc000 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:23.235103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:23.246590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8a00-963a-40ae-bbac-e6165afdb66d service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:23.398637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:23.399553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:23.400056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:23.400507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] PATH_INFO: `/v3/users/f7dffc229dac4320b0acce8359807809` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:23.402041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dffc229dac4320b0acce8359807809)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:23.404294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:23.523497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dffc229dac4320b0acce8359807809'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.524630 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dffc229dac4320b0acce8359807809'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.525547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dffc229dac4320b0acce8359807809'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.536487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dffc229dac4320b0acce8359807809'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.547667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dffc229dac4320b0acce8359807809'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:23.573638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 817/1622] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:23 2022] DELETE /identity/v3/users/f7dffc229dac4320b0acce8359807809 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:23.931832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:23.933043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.056394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f96a-345a-4929-af4b-1069910fad27 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:24.232737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:24.234780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.236364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.236845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.242173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.262015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:24.265283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.500782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:24.502352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d06a0-8b2d-4b03-a0a1-99638590a7fe service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:24.539291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 806/1623] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:23 2022] GET /identity/v3/auth/tokens => generated 3462 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:24.549643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af3ca-7202-40c5-a48e-df6d48380491 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.550098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af3ca-7202-40c5-a48e-df6d48380491 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.550551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af3ca-7202-40c5-a48e-df6d48380491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.557007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4522f5-c3be-4849-9c66-4d2805c01d60 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:24.582817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:24.583875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.584265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.584650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] PATH_INFO: `/v3/projects/7283e28ce75a459ebc56e88e03f56f76` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.587170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7283e28ce75a459ebc56e88e03f56f76)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:24.607295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:24.628330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3f6af3ca-7202-40c5-a48e-df6d48380491 None None] MFA Rules not processed for user `a7dc50f676f942319f779d8f141502f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:24.629911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3f6af3ca-7202-40c5-a48e-df6d48380491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.739888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7283e28ce75a459ebc56e88e03f56f76', 'request_id': 'req-50ef3651-a349-4685-a666-fa452cbbf110'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:24.764336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7283e28ce75a459ebc56e88e03f56f76', 'request_id': 'req-50ef3651-a349-4685-a666-fa452cbbf110'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:24.777085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 807/1624] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:24 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:24.786323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7283e28ce75a459ebc56e88e03f56f76', 'request_id': 'req-50ef3651-a349-4685-a666-fa452cbbf110'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:24.788901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8cc-9948-49d7-bd0a-89fa68426a96 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.788999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8cc-9948-49d7-bd0a-89fa68426a96 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.789502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcc8cc-9948-49d7-bd0a-89fa68426a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.814708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-31fcc8cc-9948-49d7-bd0a-89fa68426a96 None None] MFA Rules not processed for user `a7dc50f676f942319f779d8f141502f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:24.817493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-31fcc8cc-9948-49d7-bd0a-89fa68426a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.843960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] The token cache is being invalidate because project 7283e28ce75a459ebc56e88e03f56f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:24.843960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:24.849152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-50ef3651-a349-4685-a666-fa452cbbf110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:24.855835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 818/1625] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:24 2022] DELETE /identity/v3/projects/7283e28ce75a459ebc56e88e03f56f76 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:24.863247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f1a-c373-494d-808e-d514ccaf2da5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.864025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f1a-c373-494d-808e-d514ccaf2da5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.864588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80f1a-c373-494d-808e-d514ccaf2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.928220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 808/1626] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:24 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:24.930011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:24.930307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:24.930589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:24.953099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5bd80f1a-c373-494d-808e-d514ccaf2da5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:24.955123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5bd80f1a-c373-494d-808e-d514ccaf2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:24.983664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:24.986088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.076508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 809/1627] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:01:24 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:25.078097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.081151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.210201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 819/1628] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:25.212531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:25.212838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:25.213615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:25.240604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d7ff-2a28-4fb6-8717-4d7e2617afc2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:25.248782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:25.249715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:25.250198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:25.251039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] PATH_INFO: `/v3/users/f99db570ff064b06b95babd208d27f4f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:25.254098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:25.255506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99db570ff064b06b95babd208d27f4f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:25.256569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.258274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:25.290729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 820/1629] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:25.292569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.342282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0396-766c-4a7c-bef8-f2cfde00fbe0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:25.378616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:25.381252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:25.382181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:25.382720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:25.384383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:25.384507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:25.388206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:25.407849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99db570ff064b06b95babd208d27f4f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:25.409431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99db570ff064b06b95babd208d27f4f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:25.409431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99db570ff064b06b95babd208d27f4f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:25.424027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 821/1630] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:25.428651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.428887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99db570ff064b06b95babd208d27f4f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:25.434198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.440268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99db570ff064b06b95babd208d27f4f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:25.479853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 810/1631] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:25 2022] DELETE /identity/v3/users/f99db570ff064b06b95babd208d27f4f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:25.480947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.482560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.606514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ca88c-9ba2-4f8e-9fa1-611928573f1d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:25.677113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550fe14-c081-4746-8a30-ac4c71919cac admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:25.690299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:25.691091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:25.691601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:25.692131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:25.692909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:25.698320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:25.722492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:25.723350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:25.723740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:25.724125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:25.726782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.771747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 811/1632] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:25 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:25.771747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.782799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:25.927842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:25.929450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:25.949703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 822/1633] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:01:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:01:25.950447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:25.977228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee7ed5-e2bd-43ab-a28e-94318fe9b86d service swift] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:25.984436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1358c-c1b1-4ce2-a403-f64816869dc0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.000900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.001887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.002339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.002822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.009994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:26.146735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.149823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.151452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.153717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.154712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.157299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.182512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.184175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.218857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 812/1634] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:25 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:26.220403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.230029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 823/1635] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:25 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:26.231212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.232002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:26.260464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787225-9532-42fe-b13a-3dd61b474292 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.293240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fb72a-2a86-4201-a569-d2ec403489de service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.301439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.304724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.305169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.305610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.306920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.311661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.331237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.332133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.332416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.332693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] PATH_INFO: `/v3/projects/352100bf8a044c2681a5fdf2303fc567` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.334496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 824/1636] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:01:26.335320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352100bf8a044c2681a5fdf2303fc567)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.337270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.351000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.367295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23890b-407b-4400-a73f-107bff94bf75 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.377576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.381584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.387249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.387479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.388244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.389901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.412660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 825/1637] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:26.419442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.440768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f8f7-a2c4-412e-b7f7-8debfb9aa7ce admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.452408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352100bf8a044c2681a5fdf2303fc567', 'request_id': 'req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.472333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352100bf8a044c2681a5fdf2303fc567', 'request_id': 'req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.488852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352100bf8a044c2681a5fdf2303fc567', 'request_id': 'req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.503502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] The token cache is being invalidate because project 352100bf8a044c2681a5fdf2303fc567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:26.504360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.505816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.512636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 813/1638] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:26 2022] DELETE /identity/v3/projects/352100bf8a044c2681a5fdf2303fc567 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:26.515382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.517908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:26.547489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.549113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.549113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.553709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] PATH_INFO: `/v3/projects/ab60c914b24247b488de8ec2782a9c1c/users/564fe24d9d9e4569af3788ff4200994a/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.575330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab60c914b24247b488de8ec2782a9c1c, user_id=564fe24d9d9e4569af3788ff4200994a, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.579680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d50a11-78d5-4d6f-ae64-d72741a5f922 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.605785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 826/1639] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:26 2022] PUT /identity/v3/projects/ab60c914b24247b488de8ec2782a9c1c/users/564fe24d9d9e4569af3788ff4200994a/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:26.613265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c010d-d2ba-4dac-a345-cdc43988cbb5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.616878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.617167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.617445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.680687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] MFA Rules not processed for user `564fe24d9d9e4569af3788ff4200994a`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:26.684188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:26.710188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.711051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.711335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.711621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] PATH_INFO: `/v3/users/ec18edd7164848c2adc20274ee14fe25` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.713063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec18edd7164848c2adc20274ee14fe25)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.715702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.801798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec18edd7164848c2adc20274ee14fe25'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.803029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec18edd7164848c2adc20274ee14fe25'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.803954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec18edd7164848c2adc20274ee14fe25'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.811500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 827/1640] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:26 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:26.819029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.821082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:26.826509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec18edd7164848c2adc20274ee14fe25'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.842939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8288-2972-475c-9108-00c7f436a818 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:26.845902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec18edd7164848c2adc20274ee14fe25'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:26.853109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:26.853915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:26.854263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:26.854652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:26.855424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:26.860403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:26.916995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 814/1641] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:26 2022] DELETE /identity/v3/users/ec18edd7164848c2adc20274ee14fe25 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:26.931083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 828/1642] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:26 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:26.932484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:26.934126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.095719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a49075-73f9-47f3-8dc8-5f1f77195cd9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.171186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.171894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.172182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.173075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.174306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.176883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.212129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 815/1643] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:26 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:27.214950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.232575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8855e2-14f1-4660-9bca-eebb7e5cfc36 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.246291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.247002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.254285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.254285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.255025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.260497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.284070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.286209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.289044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 829/1644] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:27.294329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.339262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f02c7-c6c7-4ab4-bee1-f9f977406db1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.339453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf2616-b42f-4214-950a-6d4f24755ea6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.339453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.340186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.340449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.340710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] PATH_INFO: `/v3/projects/769fa4f3df2a40eb97720f90e6349c52/users/c2c865ef5baa4aedb98481cd37a38ff6/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.347350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.348240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.348526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.348807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] PATH_INFO: `/v3/projects/dc7763d633c84178a5d77cb41251f5a3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.350256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7763d633c84178a5d77cb41251f5a3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.352188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.383173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769fa4f3df2a40eb97720f90e6349c52, user_id=c2c865ef5baa4aedb98481cd37a38ff6, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.386966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.423030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 830/1645] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:27 2022] PUT /identity/v3/projects/769fa4f3df2a40eb97720f90e6349c52/users/c2c865ef5baa4aedb98481cd37a38ff6/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:27.427709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.463215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7763d633c84178a5d77cb41251f5a3', 'request_id': 'req-e387f7fb-987a-4fc8-907b-035a365294aa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:27.479965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7763d633c84178a5d77cb41251f5a3', 'request_id': 'req-e387f7fb-987a-4fc8-907b-035a365294aa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:27.489390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7763d633c84178a5d77cb41251f5a3', 'request_id': 'req-e387f7fb-987a-4fc8-907b-035a365294aa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:27.519990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] The token cache is being invalidate because project dc7763d633c84178a5d77cb41251f5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:27.520295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:27.540331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e387f7fb-987a-4fc8-907b-035a365294aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:27.559703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 816/1646] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:27 2022] DELETE /identity/v3/projects/dc7763d633c84178a5d77cb41251f5a3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:27.562046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf5e0-b760-453d-aac8-133d99fba675 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.564348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf5e0-b760-453d-aac8-133d99fba675 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.564786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf5e0-b760-453d-aac8-133d99fba675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.589546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff00df-5950-4807-8b9f-b25b4b2edc68 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.595953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d91bf5e0-b760-453d-aac8-133d99fba675 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:27.597211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d91bf5e0-b760-453d-aac8-133d99fba675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.689612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.690517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.690812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.691122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.691890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.693700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.708353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 831/1647] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:27.711360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.717908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 817/1648] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:27.718058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.722332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.722486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.722860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.727419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0ec2-9cbb-4d39-99c0-c372456ffd0b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.734927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.735854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.736138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.736420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] PATH_INFO: `/v3/projects/769fa4f3df2a40eb97720f90e6349c52/users/c2c865ef5baa4aedb98481cd37a38ff6/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.738519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=769fa4f3df2a40eb97720f90e6349c52, user_id=c2c865ef5baa4aedb98481cd37a38ff6, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.741257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9342-f55e-41b4-b8a4-2a057691cfdc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.746072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:27.747369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.765091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 832/1649] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:27 2022] PUT /identity/v3/projects/769fa4f3df2a40eb97720f90e6349c52/users/c2c865ef5baa4aedb98481cd37a38ff6/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:27.768080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.768543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.768805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.806212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] MFA Rules not processed for user `c2c865ef5baa4aedb98481cd37a38ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:27.809821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.845806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 818/1650] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:27.851816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.870325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47032f8e-676a-48a7-92a9-def518e9ecbb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.880364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.881066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.881352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.881633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.882469 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:27.882789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.885965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.915411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 819/1651] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:27.916757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.925230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 833/1652] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:27 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:27.928834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951550d-26f2-4da5-995a-856a30c819ea admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:27.937231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:27.940595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:27.941282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:27.941634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:27.941883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:27.942619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:27.943138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:27.944510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:27.992898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 820/1653] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:27 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:27.997210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.051230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cdaf5-8ed2-4c0b-8f7a-46079f0948ad None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.084629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13822503-a5c7-4c3f-8195-8bde2509d73d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.094336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.095556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.096067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.096994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.099387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.101615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.150767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.155729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.156019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.156363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.159134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 821/1654] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:27 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:28.163147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.175632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6c46-3b2e-482a-afd3-b2e41b10406d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.182795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.183826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.184334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.184817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.186041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.189567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.202462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 822/1655] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:28.207643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.220831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4acf2-62b7-4696-b542-a1c07e8c5c22 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.227004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.227862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.228260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.228650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.229497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.231256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.249857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 823/1656] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:28.253198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.272661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a7d0d-8054-41c3-a92b-eeda2b6f35c5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.279592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.280770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.281492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.282012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] PATH_INFO: `/v3/projects/e06d4c910d844c94b84133c57ad3b5bb/users/aefbc7b8e9be4036bf0fc2548c1dd46e/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.301506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06d4c910d844c94b84133c57ad3b5bb, user_id=aefbc7b8e9be4036bf0fc2548c1dd46e, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.304387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5352a48-0bdf-4013-87b1-da9814f8fbce admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.319388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.322836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.337877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 824/1657] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:28 2022] PUT /identity/v3/projects/e06d4c910d844c94b84133c57ad3b5bb/users/aefbc7b8e9be4036bf0fc2548c1dd46e/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:28.338038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 834/1658] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:27 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:28.366973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.392445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.392853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.459603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.482925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8d3a3-eba6-4691-8f4a-17c509650368 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.494791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] MFA Rules not processed for user `aefbc7b8e9be4036bf0fc2548c1dd46e`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:28.501134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:28.631775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.635250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.635768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.636264 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] PATH_INFO: `/v3/users/564fe24d9d9e4569af3788ff4200994a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.642096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=564fe24d9d9e4569af3788ff4200994a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.646444 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.703711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 825/1659] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:28 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:28.704892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.744781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a2371-2405-41d9-956e-b6bfb0e1a052 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:28.765947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:28.767229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564fe24d9d9e4569af3788ff4200994a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:28.767466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.767759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.768042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.768809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:28.768913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564fe24d9d9e4569af3788ff4200994a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:28.770192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564fe24d9d9e4569af3788ff4200994a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:28.776763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0643a-61f9-4565-8e0a-35158166dab8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:28.798801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564fe24d9d9e4569af3788ff4200994a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:28.829131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564fe24d9d9e4569af3788ff4200994a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:28.884483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 826/1660] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:28 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:28.895548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de194-1552-44fc-b34a-5f9d9013b3c5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:28.895998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de194-1552-44fc-b34a-5f9d9013b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:28.896180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de194-1552-44fc-b34a-5f9d9013b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:28.946404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 835/1661] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:28 2022] DELETE /identity/v3/users/564fe24d9d9e4569af3788ff4200994a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:28.952427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:28.959890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:28.992627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1f6de194-1552-44fc-b34a-5f9d9013b3c5 None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:28.994164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1f6de194-1552-44fc-b34a-5f9d9013b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:29.137418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 827/1662] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Jan 28 02:01:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:29.141939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.146859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.147990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.234871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:29.237908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:29.353004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fcd8f-8f02-4e90-a948-fac42a2fd3ff admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.368790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:29.380500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.380798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.381079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.384369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:29.398643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:29.493420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 836/1663] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:28 2022] POST /identity/v3/users => generated 292 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:29.494413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.516971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 828/1664] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:29.519834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4c90-eb13-4cf2-b4e7-4eb81a8d89cc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.525858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:29.526943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.527827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.528416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.530301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:29.533654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:29.576539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.589501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 837/1665] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:29.591420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9bda5-10a0-4ddf-a0e8-0f0a0cd337d4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.624605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:29.632189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.632551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.633009 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] PATH_INFO: `/v3/projects/07bd8061b5474acfb9b7df30ba52cb79/users/3859114491fd462cbe305d8b80eb7571/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.701702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bd8061b5474acfb9b7df30ba52cb79, user_id=3859114491fd462cbe305d8b80eb7571, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:29.713384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:29.769718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 829/1666] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:29 2022] PUT /identity/v3/projects/07bd8061b5474acfb9b7df30ba52cb79/users/3859114491fd462cbe305d8b80eb7571/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:29.774337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.798421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b224980-84a9-45b8-a4e0-cb4a755db14b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.848955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.855279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.011779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.012486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.012778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.014092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.016542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.018502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.021533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484064c8-bb7f-47f5-84c2-da7439a2dc85 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.053838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 838/1667] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:30.058093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.066437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.074194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.075022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.077306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.082778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8150-f277-42c6-bd87-7abc43ada8b5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.105658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.111905 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.115890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.122254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.122546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.122833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.137220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 830/1668] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:01:30.143056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.171564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b71b99-2e0b-43a0-a387-bd6797073475 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.184592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.184820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.184967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.184967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.184967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] PATH_INFO: `/v3/projects/07bd8061b5474acfb9b7df30ba52cb79/users/3859114491fd462cbe305d8b80eb7571/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.185312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c90f-19f4-4356-857a-d69b71108dc0 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.185393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bd8061b5474acfb9b7df30ba52cb79, user_id=3859114491fd462cbe305d8b80eb7571, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.185393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edd0ac-14b1-42a6-84ae-86190326ccf7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.198162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 831/1669] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:30 2022] PUT /identity/v3/projects/07bd8061b5474acfb9b7df30ba52cb79/users/3859114491fd462cbe305d8b80eb7571/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:30.200142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.200615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.201120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.223805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] MFA Rules not processed for user `a7dc50f676f942319f779d8f141502f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:30.224980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.230116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 839/1670] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:30.241285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579b13-f18b-4e52-be8e-9ff57fe69649 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.242822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579b13-f18b-4e52-be8e-9ff57fe69649 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.243324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0579b13-f18b-4e52-be8e-9ff57fe69649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.307136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 832/1671] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:30.346013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b0579b13-f18b-4e52-be8e-9ff57fe69649 None None] MFA Rules not processed for user `3859114491fd462cbe305d8b80eb7571`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:30.347921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b0579b13-f18b-4e52-be8e-9ff57fe69649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.539085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 840/1672] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:30.556943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.558670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.654119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ccae8-ecf2-4db4-95b8-207f7ea3b0e2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.663931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.664895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.665668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.666149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.683840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.689171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.742146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 833/1673] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:30 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:30.841371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c37-3e75-449f-b927-d570318764c4 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.842753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c37-3e75-449f-b927-d570318764c4 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.843787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32704c37-3e75-449f-b927-d570318764c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.019075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-32704c37-3e75-449f-b927-d570318764c4 None None] MFA Rules not processed for user `264a23388dc64b269325ae52eb4130de`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:31.024230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-32704c37-3e75-449f-b927-d570318764c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.243977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 841/1674] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:31.263124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.265440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.451041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820550b-9dcc-4af4-8cdb-8eff861afb65 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.475463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.477471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.479238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.479641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.513649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.519623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.555637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 834/1675] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:31 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:31.593553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704c37-3e75-449f-b927-d570318764c4 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.730918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32704c37-3e75-449f-b927-d570318764c4 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.740857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.741918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.742204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.743976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] PATH_INFO: `/v3/users/aefbc7b8e9be4036bf0fc2548c1dd46e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.746804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefbc7b8e9be4036bf0fc2548c1dd46e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.750090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.788457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.790269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.819283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c73c-8fbd-4158-b8e1-487bd292558f service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.826374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.827356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.827845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.828345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] PATH_INFO: `/v3/projects/ab60c914b24247b488de8ec2782a9c1c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.829804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab60c914b24247b488de8ec2782a9c1c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.834948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.854601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefbc7b8e9be4036bf0fc2548c1dd46e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.857943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefbc7b8e9be4036bf0fc2548c1dd46e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.860543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefbc7b8e9be4036bf0fc2548c1dd46e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.883179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefbc7b8e9be4036bf0fc2548c1dd46e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.901663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4e9ccc29-4bc1-4695-b3c4-7f2d341d6920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefbc7b8e9be4036bf0fc2548c1dd46e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.915817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab60c914b24247b488de8ec2782a9c1c', 'request_id': 'req-e634dc1f-76fe-451c-b922-47a06f9839d9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.929902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab60c914b24247b488de8ec2782a9c1c', 'request_id': 'req-e634dc1f-76fe-451c-b922-47a06f9839d9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.939321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab60c914b24247b488de8ec2782a9c1c', 'request_id': 'req-e634dc1f-76fe-451c-b922-47a06f9839d9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.939797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 842/1676] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:31 2022] DELETE /identity/v3/users/aefbc7b8e9be4036bf0fc2548c1dd46e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:31.948106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.948562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.949011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.963757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] The token cache is being invalidate because project ab60c914b24247b488de8ec2782a9c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:31.964474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.966470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:31.972955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 835/1677] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:31 2022] DELETE /identity/v3/projects/ab60c914b24247b488de8ec2782a9c1c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:31.974149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.976696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.978541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:31.981524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:32.072314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634dc1f-76fe-451c-b922-47a06f9839d9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:32.118226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 843/1678] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:32.130300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:32.131953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:32.209501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:32.210503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.210849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.211198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] PATH_INFO: `/v3/users/c2c865ef5baa4aedb98481cd37a38ff6` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.212589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c865ef5baa4aedb98481cd37a38ff6)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:32.214793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:32.288045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43694a-0ae8-4d8e-8842-6c404cec155e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:32.297822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:32.298639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.298930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.299210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.318554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:32.320023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b8f4-f3d5-4c18-b906-7e450d1109e5 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:32.320331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c865ef5baa4aedb98481cd37a38ff6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:32.321906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c865ef5baa4aedb98481cd37a38ff6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:32.322593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c865ef5baa4aedb98481cd37a38ff6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:32.341011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c865ef5baa4aedb98481cd37a38ff6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:32.343082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 844/1679] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:01:32.349296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07038a92-f0fb-4d38-8cbb-7b18b3af0703 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.349871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07038a92-f0fb-4d38-8cbb-7b18b3af0703 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.350337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07038a92-f0fb-4d38-8cbb-7b18b3af0703 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.352271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 845/1680] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:01:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:01:32.356597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c865ef5baa4aedb98481cd37a38ff6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:32.400869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.401254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.401611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.417919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 836/1681] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:31 2022] DELETE /identity/v3/users/c2c865ef5baa4aedb98481cd37a38ff6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:32.447359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:32.448626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:32.613126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 846/1682] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:32.736830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:32.739090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:32.789993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52488f1-ec81-4bac-b138-5125a423be0b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:32.800446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:32.801578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.802411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.802950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.814667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:32.816701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f37a1-11fc-4b70-a40d-8bfe270f17a9 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:32.831740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 837/1683] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:33.162338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.166636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.284725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d637-5eea-43a7-a8e6-de669a24b030 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:33.291570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:33.292748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.293035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.293477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] PATH_INFO: `/v3/projects/769fa4f3df2a40eb97720f90e6349c52` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.295032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=769fa4f3df2a40eb97720f90e6349c52)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:33.298098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:33.353661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769fa4f3df2a40eb97720f90e6349c52', 'request_id': 'req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.364387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769fa4f3df2a40eb97720f90e6349c52', 'request_id': 'req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.375881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769fa4f3df2a40eb97720f90e6349c52', 'request_id': 'req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.391184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] The token cache is being invalidate because project 769fa4f3df2a40eb97720f90e6349c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:33.391536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.392207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.398544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 847/1684] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:33 2022] DELETE /identity/v3/projects/769fa4f3df2a40eb97720f90e6349c52 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:33.400304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6a22-4ec4-44fd-bffb-203c2caa8f4b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.400665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6a22-4ec4-44fd-bffb-203c2caa8f4b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.401165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6a22-4ec4-44fd-bffb-203c2caa8f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.417953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.420225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.425822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b55e6a22-4ec4-44fd-bffb-203c2caa8f4b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:33.427611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b55e6a22-4ec4-44fd-bffb-203c2caa8f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.557078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb9f2-4a8c-4172-91c2-ec020dfb7bda admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:33.571478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:33.572372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.572660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.572940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] PATH_INFO: `/v3/projects/e06d4c910d844c94b84133c57ad3b5bb` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.574307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06d4c910d844c94b84133c57ad3b5bb)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:33.576238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:33.577390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 838/1685] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:33.587634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.588304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.589783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.617299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:33.618573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.627867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 839/1686] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:33.631915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.639530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06d4c910d844c94b84133c57ad3b5bb', 'request_id': 'req-38b05674-08f7-486e-acf5-a71681485d15'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.650757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06d4c910d844c94b84133c57ad3b5bb', 'request_id': 'req-38b05674-08f7-486e-acf5-a71681485d15'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.652113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f28a-7e6c-4e6f-83bc-dbdfc4803b96 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:33.659877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06d4c910d844c94b84133c57ad3b5bb', 'request_id': 'req-38b05674-08f7-486e-acf5-a71681485d15'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.675293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] The token cache is being invalidate because project e06d4c910d844c94b84133c57ad3b5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:33.675935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.677003 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.682428 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 848/1687] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:33 2022] DELETE /identity/v3/projects/e06d4c910d844c94b84133c57ad3b5bb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:33.686103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.692530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.798721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:33.799946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.800236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.800512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.801251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:33.801564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:33.808254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:33.834858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 840/1688] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:33.835784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.837708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:33.850923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b05674-08f7-486e-acf5-a71681485d15 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:33.854996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b381c-7e9d-414c-84e4-e717d8c47beb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:33.856798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:33.858174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.858475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.858902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] PATH_INFO: `/v3/users/3859114491fd462cbe305d8b80eb7571` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.860323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3859114491fd462cbe305d8b80eb7571)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:33.861050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:33.862117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:33.862503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:33.862621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:33.862962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:33.863765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:33.866004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:33.923177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 841/1689] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:33 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:33.924235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:33.942748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3859114491fd462cbe305d8b80eb7571'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.943462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3859114491fd462cbe305d8b80eb7571'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.945005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3859114491fd462cbe305d8b80eb7571'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.966286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3859114491fd462cbe305d8b80eb7571'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.975796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3859114491fd462cbe305d8b80eb7571'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:33.999894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 849/1690] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:33 2022] DELETE /identity/v3/users/3859114491fd462cbe305d8b80eb7571 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:34.118283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d67a8-907e-4f74-b9cb-1bd7f0dc7671 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:34.319955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:34.321681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:34.323959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:34.325180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:34.328072 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:34.333544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:34.398172 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 842/1691] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:33 2022] POST /identity/v3/users => generated 284 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:34.398958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:34.401046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:34.417894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74a55c-f605-4313-bdfd-959792fb5e1b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:34.426093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:34.428375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:34.429005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:34.429498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:34.430805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:34.436640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:34.477038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:34.486326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 850/1692] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:34.492395 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c70015-94bf-45d8-bc22-5e1b7f013e94 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:34.506468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:34.508102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:34.510166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:34.510728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:34.511678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:34.516098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251178f-40a1-40e7-88e9-c3fb3acde671 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:34.550171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:34.559894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 843/1693] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:34.567512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7f1d-2ef5-4307-a598-c0b0e840a731 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:34.582354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:34.584703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:34.588179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:34.588734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] PATH_INFO: `/v3/projects/5006e5aeeb1a418388074a380f19c45a/users/79551977570b439b8ab561901fde74ec/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:34.626837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5006e5aeeb1a418388074a380f19c45a, user_id=79551977570b439b8ab561901fde74ec, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:34.631907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:34.665481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:34.666797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:34.667177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 851/1694] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:34 2022] PUT /identity/v3/projects/5006e5aeeb1a418388074a380f19c45a/users/79551977570b439b8ab561901fde74ec/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:34.667913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:34.710337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] MFA Rules not processed for user `79551977570b439b8ab561901fde74ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:34.712312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:34.858996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 844/1695] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:34 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:34.863599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:34.917250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:34.921556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:35.073922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf1bf-92b1-4839-94f8-f8996c168d1f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.079767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.080468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.080753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.081038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.081759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.083965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.109373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee6848-4865-4ec2-85ce-937202876bfb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.138515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.141461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.141891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.143138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] PATH_INFO: `/v3/projects/07bd8061b5474acfb9b7df30ba52cb79` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.146527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bd8061b5474acfb9b7df30ba52cb79)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.148624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.224327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 852/1696] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:34 2022] POST /identity/v3/projects => generated 367 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:35.224534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.284951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bd8061b5474acfb9b7df30ba52cb79', 'request_id': 'req-45fc8f86-a403-4167-a395-b5074b5fdfb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:35.301182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bd8061b5474acfb9b7df30ba52cb79', 'request_id': 'req-45fc8f86-a403-4167-a395-b5074b5fdfb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:35.309587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bd8061b5474acfb9b7df30ba52cb79', 'request_id': 'req-45fc8f86-a403-4167-a395-b5074b5fdfb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:35.368402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] The token cache is being invalidate because project 07bd8061b5474acfb9b7df30ba52cb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:35.368402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:35.371183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-45fc8f86-a403-4167-a395-b5074b5fdfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:35.376713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 845/1697] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:34 2022] DELETE /identity/v3/projects/07bd8061b5474acfb9b7df30ba52cb79 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:35.385088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d31b-9fae-4741-929e-6168cf6696c8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.386017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d31b-9fae-4741-929e-6168cf6696c8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.387613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d31b-9fae-4741-929e-6168cf6696c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.411466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d499-de7c-47b6-897c-5267ee9b6056 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.449136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-76c6d31b-9fae-4741-929e-6168cf6696c8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:35.453973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-76c6d31b-9fae-4741-929e-6168cf6696c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:35.524932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.525647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.525965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.526233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.527121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.532007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.581909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 853/1698] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:35 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:35.585533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.587165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:35.632574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d5f5-5ac7-473f-8406-205d4481b69c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.659171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 846/1699] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:35.666048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.667031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.667155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.667542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.667733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.668227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.668686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.669574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.671646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.707968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 854/1700] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:35.710040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.726744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:35.730775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:35.733900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99df0a-2dea-4d1a-b760-6d25ba135956 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.741984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.743664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.744103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.744590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] PATH_INFO: `/v3/projects/7323edce842b46b5ab8b2745d39f9e5d/users/811f18c08c6e49acb121179c28164e70/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.747177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 847/1701] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:35.749423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.765116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a24c3-0b4b-4212-92c7-d6781d4453f3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.771653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.772845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.773345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.773859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.774719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:35.775225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.777028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.785131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7323edce842b46b5ab8b2745d39f9e5d, user_id=811f18c08c6e49acb121179c28164e70, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.788419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.817501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 848/1702] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:01:35.819951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 855/1703] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:35 2022] PUT /identity/v3/projects/7323edce842b46b5ab8b2745d39f9e5d/users/811f18c08c6e49acb121179c28164e70/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:35.823160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.827460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:35.838497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf984c-556a-4a2b-9812-83ed36487647 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.966591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd8d9-003d-498e-bb18-2396ea140c8c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:35.981934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.983450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.983726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.984097 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.987986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.990441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:35.990975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:35.991080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:35.991080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:35.991080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:35.991979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:35.994136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.049766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 856/1704] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:36.050370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.057892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 849/1705] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:35 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:36.061993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.096866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a64ec-a998-4837-9afc-9f5a714a0cc9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.205546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449f1b-9da0-492d-973e-3fffe1280f8c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.219738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.220766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.226833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.226833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.227428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:36.229561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.269590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 850/1706] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:36 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:36.273415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.293793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32858f20-69e1-4683-9d79-3b3c4f7da158 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.311519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.312453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.312943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.313734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.314636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:36.315412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.316582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.321058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.321561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.325674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] PATH_INFO: `/v3/projects/7323edce842b46b5ab8b2745d39f9e5d/users/811f18c08c6e49acb121179c28164e70/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.331070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7323edce842b46b5ab8b2745d39f9e5d, user_id=811f18c08c6e49acb121179c28164e70, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:36.346547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 851/1707] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:01:36.348574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.353661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aca45f-296e-4a8a-91be-4188efe6e57a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.381630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c32da-5857-478f-89b4-40799342115d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.400377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.401953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.401953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.401953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.402974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:36.404743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.413624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 857/1708] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:36 2022] PUT /identity/v3/projects/7323edce842b46b5ab8b2745d39f9e5d/users/811f18c08c6e49acb121179c28164e70/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:36.429825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366e9b-feee-4757-857e-36b4484380ca None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.430236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366e9b-feee-4757-857e-36b4484380ca None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.438278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366e9b-feee-4757-857e-36b4484380ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.438489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 852/1709] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:36.438489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.472703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049b43-12d4-41db-831d-56503d7ca953 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.528332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-77366e9b-feee-4757-857e-36b4484380ca None None] MFA Rules not processed for user `811f18c08c6e49acb121179c28164e70`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:36.530683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-77366e9b-feee-4757-857e-36b4484380ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:36.647352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.648274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.649180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.649479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] PATH_INFO: `/v3/projects/509839c767994a8a9af6454e5e21e03d/users/9209e578c93e49feaf8e65808a0c0301/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.672574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=509839c767994a8a9af6454e5e21e03d, user_id=9209e578c93e49feaf8e65808a0c0301, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:36.678884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:36.733028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 853/1710] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:36 2022] PUT /identity/v3/projects/509839c767994a8a9af6454e5e21e03d/users/9209e578c93e49feaf8e65808a0c0301/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:36.733028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:36.733360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 858/1711] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:36 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:36.735925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991359-df26-4f70-99a5-b3b3f9c71345 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.736220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991359-df26-4f70-99a5-b3b3f9c71345 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.736831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991359-df26-4f70-99a5-b3b3f9c71345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.740024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:36.836781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a8991359-df26-4f70-99a5-b3b3f9c71345 None None] MFA Rules not processed for user `9209e578c93e49feaf8e65808a0c0301`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:36.840149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a8991359-df26-4f70-99a5-b3b3f9c71345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:36.939494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1634a-d3db-47d1-a2c4-5ac79041a5cd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:36.951986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:36.954320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.955057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.955356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.073188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 859/1712] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:36 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:37.074878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.075172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.075460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.102331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] MFA Rules not processed for user `264a23388dc64b269325ae52eb4130de`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:37.103972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:37.149619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.151376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.168555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 854/1713] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:36 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:37.169730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.179831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 860/1714] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:37.329322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bd75a-686e-46e9-9aa6-c6995a4ea0f3 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.345115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.346012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.346295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.346561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.347291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.349349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.355546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.363833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cc289-42fa-4b8f-9658-3fa923119b98 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.373708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.377380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.377766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.380147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.384417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:37.404293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 855/1715] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:37 2022] POST /identity/v3/projects => generated 363 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:37.408182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.577941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80631ef9-cf40-4301-9641-02d0ae429266 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.584535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.585549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.585890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.586219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.586978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.589281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.620964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 856/1716] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:37 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:37.624700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.646727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.648220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.649116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f003-1355-418e-a57b-6ca215aed6aa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.670025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 861/1717] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:37 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:37.671653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.673478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.675442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.675442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.675442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.677079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671e19-74e8-4073-822b-52576d3a1d44 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.699833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 857/1718] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:37.702335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.729455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8335-b57b-44bb-bf87-f0289dedda0f service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.741142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.742173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.744106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921ddd-4ad8-4ca2-8207-3c266be4043a None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.744234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.744424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] PATH_INFO: `/v3/projects/e889746617994a7fa8267a0a94546874/users/be01637e3b9747af99938c23333c093c/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.744678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921ddd-4ad8-4ca2-8207-3c266be4043a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.744963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33921ddd-4ad8-4ca2-8207-3c266be4043a None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.746952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 858/1719] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:37.780586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.784091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.784387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.784684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e889746617994a7fa8267a0a94546874, user_id=be01637e3b9747af99938c23333c093c, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.787725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:37.820700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 862/1720] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:37 2022] PUT /identity/v3/projects/e889746617994a7fa8267a0a94546874/users/be01637e3b9747af99938c23333c093c/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:37.824841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:37.825779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:37.830296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:37.972770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e2fe8-00ba-44ff-80e9-9164f7cb1090 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:37.992397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:37.993202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:37.993681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:37.994867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:37.995269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:37.995455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 859/1721] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:01:37 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:37.998126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085a9b0-e0f8-47c9-a77f-7cf524bfe03a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:38.013090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 863/1722] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:38.017032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:38.030990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6562e49-7158-4482-ac7d-e5bb463c9063 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:38.044112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:38.045266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:38.046206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:38.048223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] PATH_INFO: `/v3/projects/e889746617994a7fa8267a0a94546874/users/be01637e3b9747af99938c23333c093c/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:38.055912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=e889746617994a7fa8267a0a94546874, user_id=be01637e3b9747af99938c23333c093c, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:38.062887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:38.089157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 860/1723] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:38 2022] PUT /identity/v3/projects/e889746617994a7fa8267a0a94546874/users/be01637e3b9747af99938c23333c093c/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:38.103922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:38.104324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:38.104667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:38.164285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] MFA Rules not processed for user `be01637e3b9747af99938c23333c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:38.166018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:38.283538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 864/1724] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:38 2022] POST /identity/v3/auth/tokens => generated 3450 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:38.294656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:38.356380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8df4-16d9-43c3-bcea-ff9c8f2c4ace admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:38.362316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:38.363214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:38.363503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:38.363784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:38.376497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:38.379059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:38.394712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 861/1725] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:38 2022] GET /identity/v3/auth/tokens => generated 3450 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:38.485597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:38.495531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34072f4-b3dc-42e1-9264-635aedbe1c0e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:38.499421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:38.500787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:38.501433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:38.501433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:38.574831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:38.576271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:38.592607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 865/1726] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:38 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:38.592842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:38.594552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:38.726589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf700d-7c72-43b7-a52e-7f6697d77592 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:38.738809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:38.739714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:38.740155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:38.740587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:38.760021 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:38.762772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ca289-2520-4ea8-a1de-0a50657fb46f service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:38.781156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 862/1727] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:38 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:42.048572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:42.050215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:42.145484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c38eff-1f0d-4d31-bd34-d4d178cd3c42 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:42.152038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:42.152935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:42.153216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:42.159725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] PATH_INFO: `/v3/users/4be475a69151423086bdd40b1a9a8c23` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:42.161212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be475a69151423086bdd40b1a9a8c23)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:42.163533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:42.262753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be475a69151423086bdd40b1a9a8c23'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:42.263895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be475a69151423086bdd40b1a9a8c23'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:42.264660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be475a69151423086bdd40b1a9a8c23'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:42.279635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be475a69151423086bdd40b1a9a8c23'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:42.290227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be475a69151423086bdd40b1a9a8c23'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:42.307729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 866/1728] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:42 2022] DELETE /identity/v3/users/4be475a69151423086bdd40b1a9a8c23 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:42.312680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:42.313231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:42.313231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:42.330895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:42.332180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:42.405050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 863/1729] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:42.420828 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:42.424167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:42.531321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4677-45a9-4bad-870a-4e680a0cac59 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:42.538639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:42.539821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:42.540287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:42.540719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:42.558647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:42.561161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:42.573995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 867/1730] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:43.348654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:43.351003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:43.374528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8413f-62ff-40c7-9387-0bb10b4ec96c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:43.393056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:43.394292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:43.394743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:43.395190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] PATH_INFO: `/v3/projects/cd7ff02f46e3402da0453aee92830397` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:43.396634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7ff02f46e3402da0453aee92830397)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:43.398816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:43.545046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7ff02f46e3402da0453aee92830397', 'request_id': 'req-141f5743-53c2-42b3-953e-5a3de910bc0f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.582112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7ff02f46e3402da0453aee92830397', 'request_id': 'req-141f5743-53c2-42b3-953e-5a3de910bc0f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.594636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7ff02f46e3402da0453aee92830397', 'request_id': 'req-141f5743-53c2-42b3-953e-5a3de910bc0f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.622927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] The token cache is being invalidate because project cd7ff02f46e3402da0453aee92830397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:43.623510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.633194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.635199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 864/1731] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:43 2022] DELETE /identity/v3/projects/cd7ff02f46e3402da0453aee92830397 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:43.639350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:43.659750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f42585-36f3-4210-8105-2a362437ad83 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:43.726138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:43.727023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:43.727312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:43.727592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] PATH_INFO: `/v3/users/0fdd5fa4506f4916ab23257659798cc1` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:43.728779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdd5fa4506f4916ab23257659798cc1)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:43.732269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:43.788317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdd5fa4506f4916ab23257659798cc1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.788981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdd5fa4506f4916ab23257659798cc1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.789595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdd5fa4506f4916ab23257659798cc1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.798186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdd5fa4506f4916ab23257659798cc1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.805310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0b576eb1-3bc4-4d76-8e15-9ca17855f1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdd5fa4506f4916ab23257659798cc1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:43.824841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 868/1732] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:43 2022] DELETE /identity/v3/users/0fdd5fa4506f4916ab23257659798cc1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:44.100438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.102146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:44.127713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5743-53c2-42b3-953e-5a3de910bc0f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.186892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.187786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.188068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.188343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] PATH_INFO: `/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.189511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75afe32b4e194f5db4dbc8f1b3081cad)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.191439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.238658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75afe32b4e194f5db4dbc8f1b3081cad', 'request_id': 'req-867f2324-49f5-4e14-84be-002139bd46e3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:44.246364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75afe32b4e194f5db4dbc8f1b3081cad', 'request_id': 'req-867f2324-49f5-4e14-84be-002139bd46e3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:44.252069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75afe32b4e194f5db4dbc8f1b3081cad', 'request_id': 'req-867f2324-49f5-4e14-84be-002139bd46e3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:44.263427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] The token cache is being invalidate because project 75afe32b4e194f5db4dbc8f1b3081cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:44.263723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:44.264380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-867f2324-49f5-4e14-84be-002139bd46e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:44.266479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 865/1733] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:44 2022] DELETE /identity/v3/projects/75afe32b4e194f5db4dbc8f1b3081cad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:44.272768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.273095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.273350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.292832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:44.294077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:44.351667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 869/1734] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:44.360876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.361393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.361765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.381544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:44.382820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:44.391612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 866/1735] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:44.395855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.405402 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4dd9-679d-42a4-a66f-5736be56c823 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.410224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.410896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.411184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.411467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.412192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:44.412509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.414140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.425573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 870/1736] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:44.429644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.439501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1c228-74b9-4e48-bcf7-0ef6393b047b None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.444219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.444819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.445100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.445377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.446103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.447988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.473238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 867/1737] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:44.477246 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.486870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130cab8-0e48-48b3-a139-0f7989e98693 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.541236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.541956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.542242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.542521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.543204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.545146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.566882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 871/1738] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:44.571086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.582989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0f756-3941-4d25-b5c8-95b33189b1f4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.588122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.588797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.589084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.589365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.590124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.591716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.604904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 868/1739] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:44.606062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.615766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19643738-090e-4c98-96dd-539ceb38a1ea admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.620405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.621077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.621363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.621644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.622532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.624118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2521a0-807c-4d13-bbbf-f21845fa62b9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.635326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 872/1740] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:44.640551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.661362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85537-4968-4ce8-ac03-a1d9cf7dd65b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.692135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.693069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.693512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.693819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] PATH_INFO: `/v3/projects/ee5d4b29b0d349f5a33a887cadfed8d6/users/bee6beee857a4de5aead991a157013fe/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.710567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5d4b29b0d349f5a33a887cadfed8d6, user_id=bee6beee857a4de5aead991a157013fe, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.713518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.727852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 869/1741] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:44 2022] PUT /identity/v3/projects/ee5d4b29b0d349f5a33a887cadfed8d6/users/bee6beee857a4de5aead991a157013fe/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:44.738442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.738925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.739015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.765469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] MFA Rules not processed for user `bee6beee857a4de5aead991a157013fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:44.766769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:44.837790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 873/1742] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:44.842314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.899633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7c22-7eae-43cb-9b0e-aa2955308f62 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.904202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:44.904853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:44.905135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:44.905409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:44.906113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:44.907979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:44.931855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 870/1743] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:44.936121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:44.947574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1b2f-53ea-4cda-b242-814081c45aa7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:44.999817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.001142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.001424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.001702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.002408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.004291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.026312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 874/1744] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:44 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:45.027470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.037701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b49-2a7c-4604-8524-37214d6340c0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.042274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.042924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.043205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.043482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.044188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.045756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.056310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 871/1745] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:45.060259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.070159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b360049-00ce-4f99-a7c7-f5fdb8c204b3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.074750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.075400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.075684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.075959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.076674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.078304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8df19-3cce-4fcf-b996-88f0a23dee80 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.087711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 875/1746] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:45.091593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.101442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d293cd-cc66-4170-a42b-4ef9e47ed3af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.105974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.106855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.107137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.107407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] PATH_INFO: `/v3/projects/2237d4075d64426c85eeaa7c5f20d0c5/users/a98d9b8c7e7c456f94dd941594e2377e/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.122020 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2237d4075d64426c85eeaa7c5f20d0c5, user_id=a98d9b8c7e7c456f94dd941594e2377e, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.124628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.137389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 872/1747] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:45 2022] PUT /identity/v3/projects/2237d4075d64426c85eeaa7c5f20d0c5/users/a98d9b8c7e7c456f94dd941594e2377e/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:45.147450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.147743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.148025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.174104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] MFA Rules not processed for user `a98d9b8c7e7c456f94dd941594e2377e`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:45.175298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:45.236599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 876/1748] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:45 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:45.241052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.322914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488258ab-c620-4f24-9717-36b011a7263e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.329112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.330128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.330564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.331068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.331964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.333934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.365003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 873/1749] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:45 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:45.370206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.381453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b1c7a-a6fe-4455-abb3-0ae83b262508 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.435542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.436470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.436752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.437026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.437758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.439710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.463143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 877/1750] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:45 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:45.464271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.475456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23fb1-3d2e-40a8-a887-8b8aaf9a4f96 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.480160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.480857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.481138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.481422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.482181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.483848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.494953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 874/1751] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:45.499533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.509717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74784e-a33a-4b7c-ae91-8316823ff0ee admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.514473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.515379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.516222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.516507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] PATH_INFO: `/v3/projects/d9a294a210024943b77bac8f63970d69/users/495629467b6449e18e3008b96e61149d/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.530935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a294a210024943b77bac8f63970d69, user_id=495629467b6449e18e3008b96e61149d, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.534188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.547218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 878/1752] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:45 2022] PUT /identity/v3/projects/d9a294a210024943b77bac8f63970d69/users/495629467b6449e18e3008b96e61149d/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:45.551045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.561168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fcc51-627b-436d-86e0-0eb5ab35c8a2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.614340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.615038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.615327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.615610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.616349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.617954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd0a36-727d-4c48-94ce-c12c3cfeef37 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.627417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 875/1753] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:45.631532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.641896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d610e-807f-4984-8a86-3bb18fa33b1a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.646474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.647361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.647649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.647929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] PATH_INFO: `/v3/projects/d9a294a210024943b77bac8f63970d69/users/495629467b6449e18e3008b96e61149d/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.651021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a294a210024943b77bac8f63970d69, user_id=495629467b6449e18e3008b96e61149d, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.656180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.668655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 879/1754] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:45 2022] PUT /identity/v3/projects/d9a294a210024943b77bac8f63970d69/users/495629467b6449e18e3008b96e61149d/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:45.679808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.680272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.680605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.711065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] MFA Rules not processed for user `495629467b6449e18e3008b96e61149d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:45.712279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:45.784472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 876/1755] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:45 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:45.794287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:45.796126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:45.870870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c3a8-bb55-4f7f-a786-d34058b6fde5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:45.878656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:45.879419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:45.879911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:45.880269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:45.893622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:45.896016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:45.906804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 880/1756] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:45 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:46.511452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:46.512832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:46.524208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12802-a2c2-42fc-a3ce-12e146a9c4ef None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:46.527664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:46.528314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:46.528596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:46.528873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:46.585592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:46.587149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a3ce3-34cd-402b-8763-01942c5c49d9 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:46.596840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 877/1757] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:46 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:50.842486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.846229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:50.986365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9f82e-b80a-4894-8b85-9900252554d7 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.999821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:51.000755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:51.001225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:51.001653 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] PATH_INFO: `/v3/users/79551977570b439b8ab561901fde74ec` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:51.006416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79551977570b439b8ab561901fde74ec)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:51.008572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:51.091759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79551977570b439b8ab561901fde74ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:51.093650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79551977570b439b8ab561901fde74ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:51.094814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79551977570b439b8ab561901fde74ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:51.108037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79551977570b439b8ab561901fde74ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:51.120469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79551977570b439b8ab561901fde74ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:51.159219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 881/1758] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:50 2022] DELETE /identity/v3/users/79551977570b439b8ab561901fde74ec => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:51.163673 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:51.164292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:51.164292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:51.182659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:51.184287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:51.251577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 878/1759] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:51.273023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:51.278443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:51.354928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e2ae-f353-4dc3-9266-69816ba4ca04 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:51.361132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:51.361977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:51.362355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:51.362973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:51.374567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:51.377543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:51.392035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 882/1760] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:51 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:52.712804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:52.714549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:52.727167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdd095-77d1-4eb9-91f9-00a6b830cce5 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:52.731853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:52.732862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:52.733142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:52.733416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] PATH_INFO: `/v3/projects/5006e5aeeb1a418388074a380f19c45a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:52.734614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5006e5aeeb1a418388074a380f19c45a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:52.736519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:52.791730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5006e5aeeb1a418388074a380f19c45a', 'request_id': 'req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.799586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5006e5aeeb1a418388074a380f19c45a', 'request_id': 'req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.805004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5006e5aeeb1a418388074a380f19c45a', 'request_id': 'req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.816489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] The token cache is being invalidate because project 5006e5aeeb1a418388074a380f19c45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:52.816779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.817462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.818998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 879/1761] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:52 2022] DELETE /identity/v3/projects/5006e5aeeb1a418388074a380f19c45a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:52.822873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:52.832801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdb7ea-01fb-4641-a52a-b8b022479296 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:52.888032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:52.888930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:52.889215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:52.889490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] PATH_INFO: `/v3/users/811f18c08c6e49acb121179c28164e70` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:52.891305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=811f18c08c6e49acb121179c28164e70)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:52.893216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:52.944407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811f18c08c6e49acb121179c28164e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.945065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811f18c08c6e49acb121179c28164e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.945791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811f18c08c6e49acb121179c28164e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.954628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811f18c08c6e49acb121179c28164e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.961924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811f18c08c6e49acb121179c28164e70'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:52.983602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 883/1762] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:52 2022] DELETE /identity/v3/users/811f18c08c6e49acb121179c28164e70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:53.134160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:53.136650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.191536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:53.194288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.228169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7d27-87f9-4396-a82a-0b1ff2e8d350 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:53.286719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:53.287615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.288004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.288386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.292791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.348114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655123f-45c5-4b14-bda8-e87edd923dee admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:53.363589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:53.364505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.364780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.365062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] PATH_INFO: `/v3/users/e1b2342ab228478bb22fd1e10e34bc3b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.367516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b2342ab228478bb22fd1e10e34bc3b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:53.369650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:53.433058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:53.434925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:53.455582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 880/1763] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:53 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:53.458868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:53.461452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.492410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b2342ab228478bb22fd1e10e34bc3b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.493376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b2342ab228478bb22fd1e10e34bc3b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.495469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b2342ab228478bb22fd1e10e34bc3b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.509914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028d46-bcc4-4783-b238-5324787e12ae service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:53.518543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:53.521959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b2342ab228478bb22fd1e10e34bc3b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.528125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.528898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.529823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] PATH_INFO: `/v3/users/9209e578c93e49feaf8e65808a0c0301` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.533549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b2342ab228478bb22fd1e10e34bc3b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.534459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9209e578c93e49feaf8e65808a0c0301)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:53.538432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:53.574838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 884/1764] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:53 2022] DELETE /identity/v3/users/e1b2342ab228478bb22fd1e10e34bc3b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:53.576123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:53.578122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.659082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9209e578c93e49feaf8e65808a0c0301'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.659822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9209e578c93e49feaf8e65808a0c0301'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.661115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9209e578c93e49feaf8e65808a0c0301'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.678573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9209e578c93e49feaf8e65808a0c0301'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.709209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-13be7af5-29c0-4f12-ae7d-22e4a7056929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9209e578c93e49feaf8e65808a0c0301'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.743243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb346d6-0ec0-435d-8fae-696058d5a923 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:53.749268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:53.752836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.752836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.752836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] PATH_INFO: `/v3/projects/7323edce842b46b5ab8b2745d39f9e5d` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.753328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7323edce842b46b5ab8b2745d39f9e5d)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:53.754964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:53.760377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 881/1765] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:53 2022] DELETE /identity/v3/users/9209e578c93e49feaf8e65808a0c0301 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:53.766204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a190b8-5ef6-4695-9c28-5b96f89d15cb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.767746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a190b8-5ef6-4695-9c28-5b96f89d15cb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.768241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a190b8-5ef6-4695-9c28-5b96f89d15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.817941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-92a190b8-5ef6-4695-9c28-5b96f89d15cb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:53.819600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-92a190b8-5ef6-4695-9c28-5b96f89d15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.839135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7323edce842b46b5ab8b2745d39f9e5d', 'request_id': 'req-6f30ac47-f85f-429e-88c6-577ea5c7ba84'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.858935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7323edce842b46b5ab8b2745d39f9e5d', 'request_id': 'req-6f30ac47-f85f-429e-88c6-577ea5c7ba84'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.868272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7323edce842b46b5ab8b2745d39f9e5d', 'request_id': 'req-6f30ac47-f85f-429e-88c6-577ea5c7ba84'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.898655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] The token cache is being invalidate because project 7323edce842b46b5ab8b2745d39f9e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:53.899086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.900247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6f30ac47-f85f-429e-88c6-577ea5c7ba84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:53.903707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 885/1766] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:53 2022] DELETE /identity/v3/projects/7323edce842b46b5ab8b2745d39f9e5d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:53.906970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d8ac-4bf6-4a77-acb4-7618da452d8e None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.907688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d8ac-4bf6-4a77-acb4-7618da452d8e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.909243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4d8ac-4bf6-4a77-acb4-7618da452d8e None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.914169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 886/1767] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:01:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:01:53.916314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.917346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.918016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.933450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 882/1768] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:53.934966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58519a0d-1d19-47f3-a7f0-10347af6069e None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:53.935322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58519a0d-1d19-47f3-a7f0-10347af6069e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:53.935732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58519a0d-1d19-47f3-a7f0-10347af6069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:53.958094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:53.959549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.970315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-58519a0d-1d19-47f3-a7f0-10347af6069e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:53.973295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-58519a0d-1d19-47f3-a7f0-10347af6069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:53.979704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 887/1769] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:53.979704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:53.981241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.000767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 883/1770] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:54.003191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5cfd6-4ee6-427c-b7d2-ca6be0b8d2a2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.003804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5cfd6-4ee6-427c-b7d2-ca6be0b8d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.006159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5cfd6-4ee6-427c-b7d2-ca6be0b8d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.032021 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-85b5cfd6-4ee6-427c-b7d2-ca6be0b8d2a2 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:54.034275 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-85b5cfd6-4ee6-427c-b7d2-ca6be0b8d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.067052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4cbf2-bf90-4708-bcd6-94f3a9cb6734 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.079387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.080060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.080341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.080708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.093339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.095423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.112505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 888/1771] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:54.113522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.134949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3e775-aa69-49a8-bfa8-7c2aceb355bb service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.142307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 884/1772] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:54.143885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.144174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.144500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.152200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.152870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.153320 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.153607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.164247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.164447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:54.165590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.165926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.176188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 885/1773] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:54.177652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.180055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.181848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 889/1774] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:54.182697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.195123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9ccd-32ad-4172-9f38-bdfff67ceb9d service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.201504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d0167-a1f4-409e-a08e-86fa54082c16 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.201661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.202525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.202816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.203788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.204521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:54.204870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.206465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.210299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.211189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.211541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.211931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.220435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 890/1775] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:54.224569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.225105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.226475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.240073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 886/1776] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:54 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:54.240697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649973-15a2-41cb-b6f9-22d6705e7204 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.248309 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.250325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.250325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.250325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.254447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.254447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.308745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 891/1777] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:54.309593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.327701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8866-c315-456a-9833-193cde89d296 service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.467819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.468578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.468870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.470182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.470930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.478267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.547276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.555966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 887/1778] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:54.562076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b32687-30ff-456a-91b7-8ff5234853e3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.575163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.576635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.576635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.576635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.577147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.582627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.595999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 892/1779] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:54.599291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.611946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c3d89-a4cf-4b11-b613-997c03dbb4a4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.617517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.618896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.618896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.618896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.619777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.621622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99d190-a0f5-47a6-bc98-61f7bc7dfc1d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.640984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 888/1780] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:54.642926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.656262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac05248-ff0b-48ab-b17d-1186777c1b41 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.673818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.675056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.675347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.675627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] PATH_INFO: `/v3/projects/9f3f6ab6f4fa45f39a96bc19168a12c9/users/5d167d8d6fb140ed88ddd2aeee4d580b/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.696118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3f6ab6f4fa45f39a96bc19168a12c9, user_id=5d167d8d6fb140ed88ddd2aeee4d580b, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.700048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.727689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 893/1781] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:54 2022] PUT /identity/v3/projects/9f3f6ab6f4fa45f39a96bc19168a12c9/users/5d167d8d6fb140ed88ddd2aeee4d580b/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:54.739545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.739897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.740182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.768567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] MFA Rules not processed for user `5d167d8d6fb140ed88ddd2aeee4d580b`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:54.770924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.838494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 889/1782] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:54.843464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.862550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:54.864394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:54.933656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8c9e-e1c5-4b3a-9872-05bca2585852 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.939956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.940747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.940747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.940938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.942141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.944740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.950033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85b1ef-3350-415a-b050-e3073d719278 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:54.962328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:54.963541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:54.964055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:54.964347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] PATH_INFO: `/v3/projects/dd02e7febf1b4e4f905b571ac25ce7f5` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:54.965868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd02e7febf1b4e4f905b571ac25ce7f5)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:54.968064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:54.974838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 894/1783] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:54.978715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.043450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd02e7febf1b4e4f905b571ac25ce7f5', 'request_id': 'req-d1bafc44-04ae-42d7-adae-20be88f74cb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.055124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd02e7febf1b4e4f905b571ac25ce7f5', 'request_id': 'req-d1bafc44-04ae-42d7-adae-20be88f74cb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.065413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd02e7febf1b4e4f905b571ac25ce7f5', 'request_id': 'req-d1bafc44-04ae-42d7-adae-20be88f74cb6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.077318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9deac2-072a-42e0-a048-14471f5acc8d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.080046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] The token cache is being invalidate because project dd02e7febf1b4e4f905b571ac25ce7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:55.081297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.082237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.084229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 890/1784] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:54 2022] DELETE /identity/v3/projects/dd02e7febf1b4e4f905b571ac25ce7f5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.088853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.092589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.194808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.195506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.195804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.196068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.196760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.197303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bafc44-04ae-42d7-adae-20be88f74cb6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.198707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.205365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.206622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.207046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.207420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] PATH_INFO: `/v3/projects/509839c767994a8a9af6454e5e21e03d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.208935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] RBAC: Authorizing `identity:delete_project(project_id=509839c767994a8a9af6454e5e21e03d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.212083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.241195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 895/1785] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:54 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:55.242626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.245637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.262413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac572f-d494-44e8-a1a0-3cff22e4d2bf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.282016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509839c767994a8a9af6454e5e21e03d', 'request_id': 'req-8d513cef-d7af-48a3-acfe-dab37dd7207c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.292988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509839c767994a8a9af6454e5e21e03d', 'request_id': 'req-8d513cef-d7af-48a3-acfe-dab37dd7207c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.300300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509839c767994a8a9af6454e5e21e03d', 'request_id': 'req-8d513cef-d7af-48a3-acfe-dab37dd7207c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.313852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] The token cache is being invalidate because project 509839c767994a8a9af6454e5e21e03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:55.314225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.317288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.323339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 891/1786] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:55 2022] DELETE /identity/v3/projects/509839c767994a8a9af6454e5e21e03d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.323339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.323978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.332498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.333396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.333681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.333999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] PATH_INFO: `/v3/users/5cea439cf0d0431bb10890cf223bf23a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.339174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513cef-d7af-48a3-acfe-dab37dd7207c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.339862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cea439cf0d0431bb10890cf223bf23a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.342250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.344565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.345449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.345741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.346049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.347271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.350804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.367375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 892/1787] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:55.367375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.371090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.385424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da7d1-8ab2-4da1-bc1a-175497a5e722 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.392613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.393410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.393695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.394003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] PATH_INFO: `/v3/users/be01637e3b9747af99938c23333c093c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.395329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be01637e3b9747af99938c23333c093c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.397103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.401456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cea439cf0d0431bb10890cf223bf23a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.402227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cea439cf0d0431bb10890cf223bf23a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.402924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cea439cf0d0431bb10890cf223bf23a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.412239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cea439cf0d0431bb10890cf223bf23a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.421162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cea439cf0d0431bb10890cf223bf23a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.441276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 896/1788] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:55 2022] DELETE /identity/v3/users/5cea439cf0d0431bb10890cf223bf23a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.442142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.443442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.446541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be01637e3b9747af99938c23333c093c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.447330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be01637e3b9747af99938c23333c093c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.448222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be01637e3b9747af99938c23333c093c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.460746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be01637e3b9747af99938c23333c093c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.470770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be01637e3b9747af99938c23333c093c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:55.491351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 893/1789] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:55 2022] DELETE /identity/v3/users/be01637e3b9747af99938c23333c093c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.539691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc7147-1644-40e2-9953-2b976559ccd1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.609262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.610370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.610737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.611019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] PATH_INFO: `/v3/projects/33daf58cae1a4a3a9a52272cc86597a0/users/51816cbce0bb4281a8dfea08fde81fa2/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.627916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33daf58cae1a4a3a9a52272cc86597a0, user_id=51816cbce0bb4281a8dfea08fde81fa2, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.630614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.648051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 897/1790] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:55 2022] PUT /identity/v3/projects/33daf58cae1a4a3a9a52272cc86597a0/users/51816cbce0bb4281a8dfea08fde81fa2/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.651843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.653246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.666106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ae57-70d5-4f9b-b52a-ce680a4a9053 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.748972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.750621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.750621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.750799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.751512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.753242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1640e0-20a3-493a-ba4f-03c233f028ce admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.766094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 894/1791] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:55.768574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.779872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f15164-fc22-4307-9c6d-f4b0b6c8e53f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.785121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.786298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.786645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.787022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] PATH_INFO: `/v3/projects/33daf58cae1a4a3a9a52272cc86597a0/users/51816cbce0bb4281a8dfea08fde81fa2/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.799492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33daf58cae1a4a3a9a52272cc86597a0, user_id=51816cbce0bb4281a8dfea08fde81fa2, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.799492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:55.820015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 898/1792] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:55 2022] PUT /identity/v3/projects/33daf58cae1a4a3a9a52272cc86597a0/users/51816cbce0bb4281a8dfea08fde81fa2/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:55.821458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.821962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.822059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.863712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] MFA Rules not processed for user `51816cbce0bb4281a8dfea08fde81fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:55.865150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.870807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.874574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.976070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 895/1793] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:55 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:55.976865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:55.978496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:55.979305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516339c7-1a9f-465a-9eb2-935606253c97 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:55.984855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:55.985973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:55.986358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:55.986636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] PATH_INFO: `/v3/projects/a541aaac57d74d9b9587b6e19af84f39` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:55.987857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a541aaac57d74d9b9587b6e19af84f39)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:55.989923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.004333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4feb463-acef-4c48-9a8f-881fd6b74624 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.009383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.010437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.010706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.011069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] PATH_INFO: `/v3/projects/e889746617994a7fa8267a0a94546874` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.012390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e889746617994a7fa8267a0a94546874)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.014356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.048083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a541aaac57d74d9b9587b6e19af84f39', 'request_id': 'req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.058429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a541aaac57d74d9b9587b6e19af84f39', 'request_id': 'req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.070805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e889746617994a7fa8267a0a94546874', 'request_id': 'req-0f506880-411d-48bf-be73-5b3d37785831'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.071676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a541aaac57d74d9b9587b6e19af84f39', 'request_id': 'req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.080909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e889746617994a7fa8267a0a94546874', 'request_id': 'req-0f506880-411d-48bf-be73-5b3d37785831'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.089427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e889746617994a7fa8267a0a94546874', 'request_id': 'req-0f506880-411d-48bf-be73-5b3d37785831'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.101303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] The token cache is being invalidate because project a541aaac57d74d9b9587b6e19af84f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:56.101968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.104396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3b8fd14a-341b-4d95-b0b5-97b9f770d0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.104545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] The token cache is being invalidate because project e889746617994a7fa8267a0a94546874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:56.104873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.105590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.107685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 896/1794] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:55 2022] DELETE /identity/v3/projects/e889746617994a7fa8267a0a94546874 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:56.109059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.114593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 899/1795] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:55 2022] DELETE /identity/v3/projects/a541aaac57d74d9b9587b6e19af84f39 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:56.115789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.116192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f902e2-b48b-4e2e-a343-f5df472afa60 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.116936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f902e2-b48b-4e2e-a343-f5df472afa60 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.117394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f902e2-b48b-4e2e-a343-f5df472afa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.173657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-42f902e2-b48b-4e2e-a343-f5df472afa60 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:56.183733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-42f902e2-b48b-4e2e-a343-f5df472afa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.201084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f506880-411d-48bf-be73-5b3d37785831 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.213074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.214534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.215872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.216495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.220025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.306211 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 900/1796] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:56.307698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa066e-9dfd-4df2-b4e2-d1595611cdfd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.307987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa066e-9dfd-4df2-b4e2-d1595611cdfd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.308268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa066e-9dfd-4df2-b4e2-d1595611cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.327376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.329196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.339223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ddfa066e-9dfd-4df2-b4e2-d1595611cdfd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:56.340728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ddfa066e-9dfd-4df2-b4e2-d1595611cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.343066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 897/1797] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:56 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:56.345162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.347057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.360791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 901/1798] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:56.361996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32746-86c3-4678-a53a-228966cb7038 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.362293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32746-86c3-4678-a53a-228966cb7038 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.367210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d32746-86c3-4678-a53a-228966cb7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.378658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33eea3-b2f9-481e-9e17-1f4b88cdee2b service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.404081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.404997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.405288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.405573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] PATH_INFO: `/v3/users/bee6beee857a4de5aead991a157013fe` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.411544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee6beee857a4de5aead991a157013fe)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.422739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.438289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-75d32746-86c3-4678-a53a-228966cb7038 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:56.439524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-75d32746-86c3-4678-a53a-228966cb7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.448678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 902/1799] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:56.452159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.452159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.452159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.471425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:56.472633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.481710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 903/1800] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:56.482491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.494433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0f0d-ab6b-444c-8fd4-65200d858c22 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.500501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.501186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.501478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.502500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.503317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:56.511831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.516383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.522278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee6beee857a4de5aead991a157013fe'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.523957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee6beee857a4de5aead991a157013fe'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.523957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee6beee857a4de5aead991a157013fe'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.532499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 904/1801] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:56.533499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.535345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee6beee857a4de5aead991a157013fe'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.536005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.544584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee6beee857a4de5aead991a157013fe'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:56.551181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad35-e1ec-46a6-a443-fd789104baa8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.559647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.560605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.560892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.561422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.562283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:56.562601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.564260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d523750-a391-4a7c-9f53-849a8d875ecc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.570511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 898/1802] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:56 2022] DELETE /identity/v3/users/bee6beee857a4de5aead991a157013fe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:56.570511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.572431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.580355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 905/1803] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:56.581703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.582036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.582294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.603743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:56.604980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.694321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940f5c-0f70-47b1-a014-dbfe5ad4df45 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.695054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 906/1804] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:56.700812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.712413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc6d52-e192-41c5-bf44-07641a767a81 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.714312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.716311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.716759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.717310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.717604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.718341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.719247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.719487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.719591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.720401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.722232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.722563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.759031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 907/1805] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:56.759200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 899/1806] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/projects => generated 401 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:56.759276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.761045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.761169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:56.860131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bde068-c0a5-4f98-89d2-b12c5f395209 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.876331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.886659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.886955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.887244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.887952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.895643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.897453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fe98-babf-4a7d-8b5e-69ed811a5486 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.928076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 900/1807] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:56.929230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.940819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0daba1-e626-4ad5-a1bb-44ee8fd93e17 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:56.947300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.947989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.948307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.948594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:56.949306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:56.951493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:56.984186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 901/1808] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:56 2022] POST /identity/v3/users => generated 301 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:56.985079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:56.988017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:56.988728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:56.989256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:56.989667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.003541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.005371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.020176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 908/1809] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:57.021011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.024077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc739d-85b6-4c28-8349-25a34c5eb137 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.034513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b5bf-86e4-410b-9ed0-8167dcbeb22a service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.040492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.041184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.041472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.041779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.042506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.044164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.057181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 909/1810] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:57.057878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.058605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.058900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.059200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.060110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.061422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.062016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.073837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761def5-77bb-46c2-b5f8-c9566ef1ddc5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.081217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.081948 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.082237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.082517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.083282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.085380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.097778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 910/1811] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:57.101597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.117533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 902/1812] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:57.118457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.121422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcf974-ca6a-4ba6-9342-aa3dd6e7bfeb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.134815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.135756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.136046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.136482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] PATH_INFO: `/v3/projects/9b0c0ba248864026bc9eea3222d3fc52/users/e21cfe5b85f64d2286deb9472a65f1f9/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.144417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2bb4-eedb-4758-a143-3e5cdce3bed0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.155724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.156458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.156762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.157520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.157874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.159533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.164378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0c0ba248864026bc9eea3222d3fc52, user_id=e21cfe5b85f64d2286deb9472a65f1f9, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.167137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.180336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 903/1813] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:57.182282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.185830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 911/1814] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:57 2022] PUT /identity/v3/projects/9b0c0ba248864026bc9eea3222d3fc52/users/e21cfe5b85f64d2286deb9472a65f1f9/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:57.188454 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.195426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.212872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7058464-be20-4030-9e2f-9ac7a5645d0d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.292126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267829a-1a7d-43fe-9545-b6ad90c0c3ec admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.299080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.299970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.300289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.300581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] PATH_INFO: `/v3/projects/7c3b94e7248a49cda5cca3302396d7f3/users/456914c8406b44bba6ba03c09d09a414/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.317262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.318456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.318748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.318866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3b94e7248a49cda5cca3302396d7f3, user_id=456914c8406b44bba6ba03c09d09a414, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.319111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] PATH_INFO: `/v3/users/5d167d8d6fb140ed88ddd2aeee4d580b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.320792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d167d8d6fb140ed88ddd2aeee4d580b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.321821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c047f-57fc-420c-8409-0653f99adbd4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.323045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.341205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 912/1815] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:57 2022] PUT /identity/v3/projects/7c3b94e7248a49cda5cca3302396d7f3/users/456914c8406b44bba6ba03c09d09a414/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:57.342716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.343117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.343538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.378287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] MFA Rules not processed for user `e21cfe5b85f64d2286deb9472a65f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:57.380485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.393978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d167d8d6fb140ed88ddd2aeee4d580b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.394672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d167d8d6fb140ed88ddd2aeee4d580b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.395302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d167d8d6fb140ed88ddd2aeee4d580b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.405578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d167d8d6fb140ed88ddd2aeee4d580b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.428169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-d9a1dba3-1583-4072-93ea-c3a6dc76f6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d167d8d6fb140ed88ddd2aeee4d580b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.462500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 904/1816] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:57 2022] DELETE /identity/v3/users/5d167d8d6fb140ed88ddd2aeee4d580b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:57.467583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69237a-03e2-413a-94d0-07b1ba86a305 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.467877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69237a-03e2-413a-94d0-07b1ba86a305 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.468159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69237a-03e2-413a-94d0-07b1ba86a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.522029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bf69237a-03e2-413a-94d0-07b1ba86a305 None None] MFA Rules not processed for user `456914c8406b44bba6ba03c09d09a414`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:57.525585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bf69237a-03e2-413a-94d0-07b1ba86a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.530747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 913/1817] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:57 2022] POST /identity/v3/auth/tokens => generated 3421 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:57.537168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.539628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.648235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 905/1818] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:57 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:57.655147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.655652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.656560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.663639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5ae7-7d9d-4717-aa2b-3e5767044aff None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.694538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:57.695780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.727734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.728783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.729041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.729396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] PATH_INFO: `/v3/projects/ee5d4b29b0d349f5a33a887cadfed8d6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.731412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5d4b29b0d349f5a33a887cadfed8d6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.734023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.770696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 906/1819] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:57.771636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.774523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.790233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a7c57-89e8-47e8-81fc-5b9d8a1c7dd0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.796058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.797478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.797789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.798070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.798793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.800863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.809634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5d4b29b0d349f5a33a887cadfed8d6', 'request_id': 'req-390c8692-d4fd-4de3-b70c-5f37f4efc26b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.819606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5d4b29b0d349f5a33a887cadfed8d6', 'request_id': 'req-390c8692-d4fd-4de3-b70c-5f37f4efc26b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.827554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5d4b29b0d349f5a33a887cadfed8d6', 'request_id': 'req-390c8692-d4fd-4de3-b70c-5f37f4efc26b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.832521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 907/1820] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:57 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:57.832521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.833637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.845204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] The token cache is being invalidate because project ee5d4b29b0d349f5a33a887cadfed8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:57.845645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.846389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:57.847947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 914/1821] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:57 2022] DELETE /identity/v3/projects/ee5d4b29b0d349f5a33a887cadfed8d6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:57.848788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.850215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.898695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace2abb-af9c-4112-943f-421f975af4ae admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.902678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.903190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.903477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.903757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.905622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.929798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8692-d4fd-4de3-b70c-5f37f4efc26b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:57.978794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:57.980271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:57.990863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 908/1822] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:57 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:57.991836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:57.993288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:57.996897 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:57.997135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:57.997422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:57.997707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:57.999834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.063878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5950b-e001-429f-be2f-0a643d2bd4e2 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.066767 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.068212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.068924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.069727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.070114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.070677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.071514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.073616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.084229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 915/1823] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:58.085011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.086714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.103163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 909/1824] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:57 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:58.103163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.106276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f52d4a-a0fe-490c-960c-5091a9a29e08 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.107554 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.116043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.117145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.117614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.118113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] PATH_INFO: `/v3/users/a98d9b8c7e7c456f94dd941594e2377e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.119698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98d9b8c7e7c456f94dd941594e2377e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.122442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.129997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bceb3e-e6be-4a1d-afd5-9d311fa2eab0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.137008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.137924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.138227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.138509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] PATH_INFO: `/v3/users/456914c8406b44bba6ba03c09d09a414` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.139710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456914c8406b44bba6ba03c09d09a414)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.141955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.190763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98d9b8c7e7c456f94dd941594e2377e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.191725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98d9b8c7e7c456f94dd941594e2377e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.192382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98d9b8c7e7c456f94dd941594e2377e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.200687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98d9b8c7e7c456f94dd941594e2377e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.212321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98d9b8c7e7c456f94dd941594e2377e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.216706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456914c8406b44bba6ba03c09d09a414'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.217646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456914c8406b44bba6ba03c09d09a414'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.220056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456914c8406b44bba6ba03c09d09a414'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.233212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456914c8406b44bba6ba03c09d09a414'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.238172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 916/1825] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:58 2022] DELETE /identity/v3/users/a98d9b8c7e7c456f94dd941594e2377e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:58.239071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.249686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-38549a12-1c6d-4c29-a501-b3b96de16ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456914c8406b44bba6ba03c09d09a414'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.255151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.300651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 910/1826] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:58 2022] DELETE /identity/v3/users/456914c8406b44bba6ba03c09d09a414 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:58.304906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.305216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.305495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.336123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:58.338095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.379747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b1be-72f2-4108-9995-f5500d753c5d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.418968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 911/1827] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:58.440021 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.441471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.491814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.492567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.492855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.493508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.497507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.499361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.522169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 917/1828] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:58.523103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.527255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.558102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ac55-465d-43f9-a574-fbe8aeaf09af admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.574151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400fcd-3ddf-4c44-a5d8-d133d13ecdc8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.575963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.576870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.577196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.577481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] PATH_INFO: `/v3/projects/9f3f6ab6f4fa45f39a96bc19168a12c9` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.579266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3f6ab6f4fa45f39a96bc19168a12c9)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.580782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.581215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.581790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.581969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.582558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.596119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.597779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.611149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 912/1829] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:58 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:58.612841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.614978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.638901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3f6ab6f4fa45f39a96bc19168a12c9', 'request_id': 'req-c115cd08-c7f3-4624-bd0e-4d69c184b30e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.641796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc3c7-8276-43f4-8be8-6f89f660b498 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.652263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3f6ab6f4fa45f39a96bc19168a12c9', 'request_id': 'req-c115cd08-c7f3-4624-bd0e-4d69c184b30e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.660568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3f6ab6f4fa45f39a96bc19168a12c9', 'request_id': 'req-c115cd08-c7f3-4624-bd0e-4d69c184b30e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.674211 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] The token cache is being invalidate because project 9f3f6ab6f4fa45f39a96bc19168a12c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:58.674500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.675426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.679824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 918/1830] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:58 2022] DELETE /identity/v3/projects/9f3f6ab6f4fa45f39a96bc19168a12c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:58.680865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.686972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.728006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.738915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.739125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.739415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] PATH_INFO: `/v3/projects/7812bd6b90694affabb9a7673a1356a8/users/b60a8ce9d3474e8db945bf89b54439bd/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.757397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7812bd6b90694affabb9a7673a1356a8, user_id=b60a8ce9d3474e8db945bf89b54439bd, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.760188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.789877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 913/1831] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:58 2022] PUT /identity/v3/projects/7812bd6b90694affabb9a7673a1356a8/users/b60a8ce9d3474e8db945bf89b54439bd/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:58.791451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:58.794044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:58.797492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cd08-c7f3-4624-bd0e-4d69c184b30e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.862581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.863525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.863866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.864146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] PATH_INFO: `/v3/users/51816cbce0bb4281a8dfea08fde81fa2` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.865425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51816cbce0bb4281a8dfea08fde81fa2)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.867467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.868133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4368ac9-0da3-4e43-8337-e2569e843411 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:58.873188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:58.874249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:58.874637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:58.875589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] PATH_INFO: `/v3/projects/2237d4075d64426c85eeaa7c5f20d0c5` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:58.877004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2237d4075d64426c85eeaa7c5f20d0c5)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:58.879208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:58.955738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51816cbce0bb4281a8dfea08fde81fa2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.956493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51816cbce0bb4281a8dfea08fde81fa2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.957172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51816cbce0bb4281a8dfea08fde81fa2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.957511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2237d4075d64426c85eeaa7c5f20d0c5', 'request_id': 'req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.969901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51816cbce0bb4281a8dfea08fde81fa2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.972560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2237d4075d64426c85eeaa7c5f20d0c5', 'request_id': 'req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.978679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2237d4075d64426c85eeaa7c5f20d0c5', 'request_id': 'req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.984974 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51816cbce0bb4281a8dfea08fde81fa2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:58.994266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] The token cache is being invalidate because project 2237d4075d64426c85eeaa7c5f20d0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:58.995835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.013087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.022183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 914/1832] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:58 2022] DELETE /identity/v3/projects/2237d4075d64426c85eeaa7c5f20d0c5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.022183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.025136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.038725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 919/1833] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:58 2022] DELETE /identity/v3/users/51816cbce0bb4281a8dfea08fde81fa2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.039719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.043681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.129799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdbaa-b1bf-4e7e-bbcd-c7c64e9fb1f6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.169843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29ced-583a-4982-9fa3-31d468a5b58a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.183251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.185850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.186400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.186686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] PATH_INFO: `/v3/users/495629467b6449e18e3008b96e61149d` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.192078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=495629467b6449e18e3008b96e61149d)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:59.196140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:59.235345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.236977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.239553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.240106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.241226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:59.243945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:59.260916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 915/1834] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:59.261073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495629467b6449e18e3008b96e61149d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.261858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495629467b6449e18e3008b96e61149d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.262538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495629467b6449e18e3008b96e61149d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.262754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.264957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.275160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495629467b6449e18e3008b96e61149d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.279829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb747ea-4de4-4b23-a804-cbd4ece39143 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.284853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495629467b6449e18e3008b96e61149d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.286067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.287082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.287370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.287647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] PATH_INFO: `/v3/projects/7c3b94e7248a49cda5cca3302396d7f3` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.289424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3b94e7248a49cda5cca3302396d7f3)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:59.290799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:59.312864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 920/1835] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:59 2022] DELETE /identity/v3/users/495629467b6449e18e3008b96e61149d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.313906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.315384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.387139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3b94e7248a49cda5cca3302396d7f3', 'request_id': 'req-a61b619f-751e-4b90-b9a4-e0382eecd7f3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.413891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3b94e7248a49cda5cca3302396d7f3', 'request_id': 'req-a61b619f-751e-4b90-b9a4-e0382eecd7f3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.428950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9cd7-7287-4e62-bc4b-4b7729795bea admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.435801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3b94e7248a49cda5cca3302396d7f3', 'request_id': 'req-a61b619f-751e-4b90-b9a4-e0382eecd7f3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.477618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] The token cache is being invalidate because project 7c3b94e7248a49cda5cca3302396d7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:59.477947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.480707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a61b619f-751e-4b90-b9a4-e0382eecd7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.486390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 916/1836] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:59 2022] DELETE /identity/v3/projects/7c3b94e7248a49cda5cca3302396d7f3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.492528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a171-513a-4e0a-bea1-3855d40eefc5 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.493403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a171-513a-4e0a-bea1-3855d40eefc5 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.494177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3a171-513a-4e0a-bea1-3855d40eefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.522322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.524178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.524178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.524178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] PATH_INFO: `/v3/projects/7812bd6b90694affabb9a7673a1356a8/users/b60a8ce9d3474e8db945bf89b54439bd/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.526894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7812bd6b90694affabb9a7673a1356a8, user_id=b60a8ce9d3474e8db945bf89b54439bd, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:59.530692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:59.535479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-abd3a171-513a-4e0a-bea1-3855d40eefc5 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:59.536979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-abd3a171-513a-4e0a-bea1-3855d40eefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.545886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 921/1837] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:59 2022] PUT /identity/v3/projects/7812bd6b90694affabb9a7673a1356a8/users/b60a8ce9d3474e8db945bf89b54439bd/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.546692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.548304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.674291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 917/1838] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:59.680233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4ac0-0ab0-4ace-8a2a-e6a432f6b032 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.680727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4ac0-0ab0-4ace-8a2a-e6a432f6b032 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.681158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4ac0-0ab0-4ace-8a2a-e6a432f6b032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.705718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c4e21-fbb9-4c82-8a7e-115deca51e32 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.732727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.733967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.734450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.734878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] PATH_INFO: `/v3/projects/33daf58cae1a4a3a9a52272cc86597a0` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.737278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33daf58cae1a4a3a9a52272cc86597a0)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:59.739286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:59.745621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6f1f4ac0-0ab0-4ace-8a2a-e6a432f6b032 None None] MFA Rules not processed for user `b60a8ce9d3474e8db945bf89b54439bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:59.750470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6f1f4ac0-0ab0-4ace-8a2a-e6a432f6b032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.851770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33daf58cae1a4a3a9a52272cc86597a0', 'request_id': 'req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.865029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33daf58cae1a4a3a9a52272cc86597a0', 'request_id': 'req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.873032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33daf58cae1a4a3a9a52272cc86597a0', 'request_id': 'req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.876765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 918/1839] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:59 2022] POST /identity/v3/auth/tokens => generated 3488 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:59.878225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d622-5561-4899-8c35-671d78801199 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.878741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d622-5561-4899-8c35-671d78801199 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.879122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d622-5561-4899-8c35-671d78801199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.893715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] The token cache is being invalidate because project 33daf58cae1a4a3a9a52272cc86597a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:59.894199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.894845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:59.897637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 922/1840] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:59 2022] DELETE /identity/v3/projects/33daf58cae1a4a3a9a52272cc86597a0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:59.898458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:59.899853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.908614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f9f2d622-5561-4899-8c35-671d78801199 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:59.910086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f9f2d622-5561-4899-8c35-671d78801199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.975841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8bca8-41ac-4148-8c30-394dea7f3fe9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:59.979873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:59.980533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.980823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.981106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:59.983034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:59.997889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 919/1841] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:59.999302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:59.999862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:59.999970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.018354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:00.019583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.027579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 920/1842] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:01:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:00.034794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.034794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.041476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787db77-5a17-499c-baae-b8847fb0d41d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.045105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.046698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.046943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.047802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.048090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.048372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] PATH_INFO: `/v3/projects/d9a294a210024943b77bac8f63970d69` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.049560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a294a210024943b77bac8f63970d69)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.051502 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.057102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 923/1843] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:59 2022] GET /identity/v3/auth/tokens => generated 3488 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:00.057741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.070794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef8cbe-1712-4b39-8703-77b1542505e8 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.077629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.079081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.079431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.079786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.080972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:00.081673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.083493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd51eba-3422-4c44-98b1-65f192ab4e99 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.096433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 924/1844] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:00.097839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9d5-078a-4849-bdbc-533b3a745c95 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.098183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9d5-078a-4849-bdbc-533b3a745c95 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.098482 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ea9d5-078a-4849-bdbc-533b3a745c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.118269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-987ea9d5-078a-4849-bdbc-533b3a745c95 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:00.118269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-987ea9d5-078a-4849-bdbc-533b3a745c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.127131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a294a210024943b77bac8f63970d69', 'request_id': 'req-27ca7a00-afa4-4512-94d2-0d6baeae49d6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:00.142647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a294a210024943b77bac8f63970d69', 'request_id': 'req-27ca7a00-afa4-4512-94d2-0d6baeae49d6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:00.151649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a294a210024943b77bac8f63970d69', 'request_id': 'req-27ca7a00-afa4-4512-94d2-0d6baeae49d6'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:00.166745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] The token cache is being invalidate because project d9a294a210024943b77bac8f63970d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:00.166997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:00.168332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:00.169791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 921/1845] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:00 2022] DELETE /identity/v3/projects/d9a294a210024943b77bac8f63970d69 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:00.174729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.178974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.195107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 925/1846] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:00.202378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.203732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.204184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.222746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:00.223942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.238865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 926/1847] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:00.238865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.250304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08878fb5-11c0-45ec-94bb-2a8a5b8e3b4d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.250304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.250304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.250600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.250860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.251585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:00.251883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.253473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.266326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca7a00-afa4-4512-94d2-0d6baeae49d6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.272458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 927/1848] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:00.272458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.274459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.276752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.277496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.277921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.278223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.278982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.280875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f9234-6f2e-4a03-a801-10587a7b4304 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.310051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 922/1849] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.310051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.310051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.310051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.328963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:00.331128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.339517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca940bd-49e8-4658-baa9-646978bc204b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.390161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.391436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.391747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.392027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.393977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.400893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 923/1850] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:00.402094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.411686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980151b0-c2a1-4015-9ad5-78ad4cd3f4b0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.418036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.418892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.419175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.419446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.420414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.423106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.465848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 924/1851] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.466935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.475769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.477711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.490827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 928/1852] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/auth/tokens => generated 3421 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:00.491956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.508967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac82019-4ab1-40b2-bc1e-cc230b1d476c service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.556460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32611f-3913-40fd-9546-2c722689d15d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.570839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.571669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.572053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.572408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.573389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.575795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.584764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.587239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.587536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.587968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.590210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:00.590965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.592987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.600343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 925/1853] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/users => generated 281 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.601316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.612338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 929/1854] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:00.613579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd32c3-20f9-448d-9d4e-c99e6b7c91ea admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.615163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.627770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b678f8-8e15-4e83-a1e2-4f906b576189 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.628040 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.628763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.629076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.629326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.630135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.632277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.633191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.634056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.634360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.634672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.635397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.637281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.658527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 926/1855] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.659532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.661547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 930/1856] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:00.662477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.670648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a266bc-600b-4414-80e3-1de730afc90f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.674728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e3780-1c11-486e-8918-5137dd41510b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.676956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.677879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.678341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.679070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.679962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.680733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.681682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.682139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.682587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.682689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.683604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.685609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.698985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 931/1857] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:00.699680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.712579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee04e8-cf55-44c1-87a3-cd27c93ac47c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.719167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.720001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.720286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.720565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.721287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.725287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 927/1858] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.725287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.725457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.735486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 932/1859] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:00.736218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.749414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7feda0-0669-4c51-98a2-02db129d8922 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.851338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac785-c194-41a5-95b0-85d0bc06a683 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.866406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.866555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.866555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.866555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.866555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.867011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.867011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.867011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.867547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.867631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.867711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.867796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.880649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 928/1860] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:00.880649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.889644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883ee3-a4e8-4447-b42c-e89f6cc867ef admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.890504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 933/1861] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:00.891535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.904866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.904866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.904866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.904866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] PATH_INFO: `/v3/projects/8fee78aa3233496bbde86784e80373d0/users/2c0673f7797747c9958f89278c939c2a/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.905562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7579-aacf-42f3-bedf-df28326ab56e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.910459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.911735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.912147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.912391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] PATH_INFO: `/v3/projects/8d1720fe5a1041c9977376e01863188e/users/2acdc4274c2145509d27e84c7335d006/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.932691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1720fe5a1041c9977376e01863188e, user_id=2acdc4274c2145509d27e84c7335d006, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.946540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.965909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fee78aa3233496bbde86784e80373d0, user_id=2c0673f7797747c9958f89278c939c2a, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.966316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f789d1d-17c8-4762-9a31-fea0df5dd994 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.977052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 934/1862] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:00 2022] PUT /identity/v3/projects/8d1720fe5a1041c9977376e01863188e/users/2acdc4274c2145509d27e84c7335d006/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:00.981707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.989808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 929/1863] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:00 2022] PUT /identity/v3/projects/8fee78aa3233496bbde86784e80373d0/users/2c0673f7797747c9958f89278c939c2a/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:00.991798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6973e-19a0-423d-af64-6dfc8a842b58 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.992093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6973e-19a0-423d-af64-6dfc8a842b58 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.992373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6973e-19a0-423d-af64-6dfc8a842b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.015674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-74f6973e-19a0-423d-af64-6dfc8a842b58 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:01.016862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-74f6973e-19a0-423d-af64-6dfc8a842b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.071694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30954b-1b20-4ef0-a87f-76136051bb7f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.079933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 930/1864] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:01.081257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.081544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.081871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.107844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] MFA Rules not processed for user `2c0673f7797747c9958f89278c939c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:01.108968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.129386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.130202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.130548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.130920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.131708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.133357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.143762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 935/1865] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:01.144420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.146117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.175823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 931/1866] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3381 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:01.176736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.190032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6735-a19a-437e-85db-828d2e210e53 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.195851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.196521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.196808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.197084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.197895 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.199681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.210260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 932/1867] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:01.210974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.211630 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404885f-2517-410f-899d-b9a3b58b2c22 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.215559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.216226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.216513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.216796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.227480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.228906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.238810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 936/1868] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.239571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.248643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94859-0200-41fa-a03f-9026158994ba service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.254339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.255237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.255515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.255789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] PATH_INFO: `/v3/projects/b14673aa19d64d2faabb8d9797a4a826/users/eda02f15942a4ac1be991fc556b313e4/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.277982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14673aa19d64d2faabb8d9797a4a826, user_id=eda02f15942a4ac1be991fc556b313e4, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.281057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541008a-0f2c-4e3c-9529-e439354d096d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.281731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294328f-f929-4c6a-8b6b-5c26a5c2d913 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.286245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.286927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.287236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.287751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.297629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.299180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.300261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 937/1869] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:01 2022] PUT /identity/v3/projects/b14673aa19d64d2faabb8d9797a4a826/users/eda02f15942a4ac1be991fc556b313e4/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:01.314019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.314319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.314591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.320220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 933/1870] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3381 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.334633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.351156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aec91-c580-4656-afc7-42ee261ef7ea service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.352227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] MFA Rules not processed for user `eda02f15942a4ac1be991fc556b313e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:01.354122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.442066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.443047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.443429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.443844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] PATH_INFO: `/v3/users/2c0673f7797747c9958f89278c939c2a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.445422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0673f7797747c9958f89278c939c2a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.447542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.452715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 938/1871] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:01.458299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.482189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32a22-a8f8-44d0-947a-40fbe036cdf5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.491308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.491999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.492283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.492905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.493396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.496194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.526501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0673f7797747c9958f89278c939c2a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.527388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0673f7797747c9958f89278c939c2a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.528241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0673f7797747c9958f89278c939c2a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.540048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0673f7797747c9958f89278c939c2a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.544772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 939/1872] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:01.549711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.552607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.553545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0749f923-643c-4ef0-9b0c-94bc10b034fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0673f7797747c9958f89278c939c2a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.585301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 934/1873] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:01 2022] DELETE /identity/v3/users/2c0673f7797747c9958f89278c939c2a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:01.591424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.591942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.592516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.615254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:01.617027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.628468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effef02-bca3-4c1b-b9fa-39705ecf7b32 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.712622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 935/1874] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:01.727542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.729270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.780184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.781205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.781711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.782781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.783702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.785822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.811451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 940/1875] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:01.815800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0f22-8c7b-4e52-95fe-be44f3594054 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.817130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.824428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.825316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.826075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.826423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.829221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa738d-e7a0-4560-b399-bc905a206e76 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.834451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.836680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.837162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.838039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.840355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.842238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.857472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 941/1876] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:01.860100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.861912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.863458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.877910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4e4ad-58b7-4e71-868f-047e241dd9e9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.884510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 936/1877] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.892573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.893704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.894120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.894668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] PATH_INFO: `/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1/users/fdc038514ded4bbaa1dc747d98daee5a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.916292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3b56d4ddc94a85bfdc240acc3a6de1, user_id=fdc038514ded4bbaa1dc747d98daee5a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.919756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.943575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 942/1878] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:01 2022] PUT /identity/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1/users/fdc038514ded4bbaa1dc747d98daee5a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:01.944752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.956169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73125ebb-56b8-4cc2-bb3f-5341686a3720 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.047355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.048227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.048564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.048843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.049621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.051556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c40789-0803-4af3-9b5f-fec82a2f8c3e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.067799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 937/1879] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:02.072632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.087177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b04b-0758-40a2-9360-03b6fdadade2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.100741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.101639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.101951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.102239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] PATH_INFO: `/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1/users/fdc038514ded4bbaa1dc747d98daee5a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.106418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3b56d4ddc94a85bfdc240acc3a6de1, user_id=fdc038514ded4bbaa1dc747d98daee5a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.109798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.138082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 943/1880] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:02 2022] PUT /identity/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1/users/fdc038514ded4bbaa1dc747d98daee5a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:02.156274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d380b-0376-4a82-a825-80a85649f09f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.156274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d380b-0376-4a82-a825-80a85649f09f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.156274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d380b-0376-4a82-a825-80a85649f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.217647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c42d380b-0376-4a82-a825-80a85649f09f None None] MFA Rules not processed for user `fdc038514ded4bbaa1dc747d98daee5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.221967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c42d380b-0376-4a82-a825-80a85649f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.335272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 938/1881] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.363661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.365591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.431641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.431927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.432206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.464918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df2c4-21ae-4003-a840-982b4602f737 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.475097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] MFA Rules not processed for user `2acdc4274c2145509d27e84c7335d006`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.476591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.476823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.490519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.490519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.490519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.506372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.508395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.523024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 944/1882] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:02 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:02.524374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.526189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.612162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 939/1883] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.615391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.618433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.627141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92831e0-003c-457b-9f26-2ba9eef45837 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.632807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.633909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.634367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.634742 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] PATH_INFO: `/v3/projects/8fee78aa3233496bbde86784e80373d0` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.636441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fee78aa3233496bbde86784e80373d0)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.638733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.663285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39706f-c91b-432e-8623-fe61e64bd3bd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.675910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.677624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.679080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.679369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.681440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.684202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.731247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 940/1884] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:02.737523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.747595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fee78aa3233496bbde86784e80373d0', 'request_id': 'req-07acb289-ea23-458e-94e7-1e5561e81c4d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.763338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fee78aa3233496bbde86784e80373d0', 'request_id': 'req-07acb289-ea23-458e-94e7-1e5561e81c4d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.773570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fee78aa3233496bbde86784e80373d0', 'request_id': 'req-07acb289-ea23-458e-94e7-1e5561e81c4d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.786492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] The token cache is being invalidate because project 8fee78aa3233496bbde86784e80373d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:02.786949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.788189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.790424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 945/1885] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:02 2022] DELETE /identity/v3/projects/8fee78aa3233496bbde86784e80373d0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:02.791366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.797979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.813977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764acd53-2253-49fc-a9a0-79ed058e35a4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.819508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.820359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.820811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.821246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.822127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.824202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6306e-1114-4484-b141-9357adb5ac42 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.850044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 941/1886] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:02.851752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.852185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.852680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.873090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acb289-ea23-458e-94e7-1e5561e81c4d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.876881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.878141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.892887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 942/1887] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.892887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.892887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.900689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea660ece-4469-461f-8afd-3451ec12b2c3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.905783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.907254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.907698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.907981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.908748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.910460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e772cb-482f-44dd-9c7f-84c56fb5f177 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.923817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 943/1888] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:02.926120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.926423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.926689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.937078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.937849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.938139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.938418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.940306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.945356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.946846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.956556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 944/1889] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.958548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.971305 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682274-2bcf-44db-9f14-6439a06c614b None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.976398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.977293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.977593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.977888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] PATH_INFO: `/v3/projects/0d2a985f9ef84085b886cbd344a0709a/users/6e9cb1da3b014bb1bf1186de493a2f88/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.992272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2a985f9ef84085b886cbd344a0709a, user_id=6e9cb1da3b014bb1bf1186de493a2f88, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.995030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.001335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.003111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.007767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 945/1890] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:02 2022] PUT /identity/v3/projects/0d2a985f9ef84085b886cbd344a0709a/users/6e9cb1da3b014bb1bf1186de493a2f88/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:03.008629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.012127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 946/1891] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:02 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:03.012956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.025322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c05d7-0e3c-4184-b1c6-3b1b06e4db29 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.090200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.090200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.090200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.090200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.090992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.091078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f25ca-110a-4445-bbe8-0f5794879bb8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.091425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.094924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.095595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.095878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.096153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.097178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:03.097301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.099281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.112301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 946/1892] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:03.112839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 947/1893] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.118517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.118652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.134481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f256f-d068-4444-a023-60110b0638fa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.137917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9ba3e-26d9-425d-9d00-0c9a2fc1efb3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.141282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.142407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.142799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.143037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] PATH_INFO: `/v3/projects/0d2a985f9ef84085b886cbd344a0709a/users/6e9cb1da3b014bb1bf1186de493a2f88/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.148420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2a985f9ef84085b886cbd344a0709a, user_id=6e9cb1da3b014bb1bf1186de493a2f88, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.148516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.148726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.148956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.149231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.149892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.150068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.151953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.163266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 947/1894] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:03 2022] PUT /identity/v3/projects/0d2a985f9ef84085b886cbd344a0709a/users/6e9cb1da3b014bb1bf1186de493a2f88/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:03.193803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 948/1895] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.197997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.306874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8126a3-a610-4162-bd5b-3a13c89cf00d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.358491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.360770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.399890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.400684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.401056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.401405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.402392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.405494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.438778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 948/1896] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.442670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.454193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a93363-21b5-4857-9a63-12ef0b7bf00a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.454740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbd8ac-9991-4881-a8b5-8e561fe7a3e0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.460677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.460965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.461520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.462047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.462397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.462703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.463206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.463306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.463889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] PATH_INFO: `/v3/users/eda02f15942a4ac1be991fc556b313e4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.465037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.465740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda02f15942a4ac1be991fc556b313e4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.468070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.478107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 949/1897] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:03.482044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.495545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6788-926e-49bd-9b9e-50ce254b7799 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.502114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.502912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.503198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.503504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.505290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.506948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.517725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 950/1898] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.521898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.531921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48deedf7-c164-4434-a071-773909e4d09b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.539234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.541168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.541168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.541367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] PATH_INFO: `/v3/projects/d4717e6aac8e452dbc45a32ab322184b/users/d1de3df741054545a9b740289a33fb10/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.544890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda02f15942a4ac1be991fc556b313e4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:03.545805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda02f15942a4ac1be991fc556b313e4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:03.547221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda02f15942a4ac1be991fc556b313e4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:03.569642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda02f15942a4ac1be991fc556b313e4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:03.579262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4717e6aac8e452dbc45a32ab322184b, user_id=d1de3df741054545a9b740289a33fb10, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.583523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0888b636-6f1f-4eb5-a49e-8800f513146f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda02f15942a4ac1be991fc556b313e4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:03.585043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315bd56-3a12-4ca6-baae-6160f6ab929d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.617249 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 951/1899] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:03 2022] PUT /identity/v3/projects/d4717e6aac8e452dbc45a32ab322184b/users/d1de3df741054545a9b740289a33fb10/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:03.617420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 949/1900] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:03 2022] DELETE /identity/v3/users/eda02f15942a4ac1be991fc556b313e4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:03.619431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.619729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.620276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.631060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.631349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.631632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.663077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:03.664747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.712923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] MFA Rules not processed for user `d1de3df741054545a9b740289a33fb10`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:03.714487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.748799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 950/1901] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:03.785946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.799253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.816519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 952/1902] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:03.828777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.830600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.872139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c36c8-1d79-4393-b124-2ecb31758ee1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.876879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.878096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.878629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.879086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.891013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.895814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.898871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856260f2-99f9-4cde-988a-b2cce1ef0e7c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.903039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.903815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.904173 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.904528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.908069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 951/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:03.914421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.915794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8b439-90a5-446a-8e75-a06e793a3738 service glance] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.926588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 953/1904] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:04.209113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.210785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.225589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592783-fb91-4bb6-bd3b-e59aa9c24888 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.233130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.234233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.234633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.235083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] PATH_INFO: `/v3/users/e21cfe5b85f64d2286deb9472a65f1f9` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.236517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21cfe5b85f64d2286deb9472a65f1f9)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.239352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.315036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21cfe5b85f64d2286deb9472a65f1f9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.315937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21cfe5b85f64d2286deb9472a65f1f9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.317922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21cfe5b85f64d2286deb9472a65f1f9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.356635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21cfe5b85f64d2286deb9472a65f1f9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.367617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21cfe5b85f64d2286deb9472a65f1f9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.416022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 952/1905] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:04 2022] DELETE /identity/v3/users/e21cfe5b85f64d2286deb9472a65f1f9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:04.421062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.421572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.421885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.441197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:04.443011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.576369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 954/1906] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:04.614356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.617962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.677019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.678514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.696248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fac806-a314-4e24-8e4f-8cadc369291d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.706709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.707619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.707904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.708214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] PATH_INFO: `/v3/projects/b14673aa19d64d2faabb8d9797a4a826` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.709675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14673aa19d64d2faabb8d9797a4a826)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.709928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249f1a-f8b8-49d5-8065-d28e5a15dfc9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.711684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.715091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.716153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.716696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.717201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.753860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.760215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf85b3a-530b-423d-a1f5-0965a186bd5c service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.774766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 953/1907] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:04.827307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14673aa19d64d2faabb8d9797a4a826', 'request_id': 'req-056d7de0-c84e-4a13-9e87-be68ee1f60c8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.846401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14673aa19d64d2faabb8d9797a4a826', 'request_id': 'req-056d7de0-c84e-4a13-9e87-be68ee1f60c8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.855791 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14673aa19d64d2faabb8d9797a4a826', 'request_id': 'req-056d7de0-c84e-4a13-9e87-be68ee1f60c8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.882261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.882559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.883069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.897175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] The token cache is being invalidate because project b14673aa19d64d2faabb8d9797a4a826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:04.897467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.899443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:04.902803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 955/1908] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:04 2022] DELETE /identity/v3/projects/b14673aa19d64d2faabb8d9797a4a826 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:04.912698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.916591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.941117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] MFA Rules not processed for user `6e9cb1da3b014bb1bf1186de493a2f88`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:04.950449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:05.010980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d7de0-c84e-4a13-9e87-be68ee1f60c8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.017346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.018434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.018823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.019608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] PATH_INFO: `/v3/users/fdc038514ded4bbaa1dc747d98daee5a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.021270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc038514ded4bbaa1dc747d98daee5a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.023519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.052071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 954/1909] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:04 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:05.076836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:05.078508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:05.128034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc038514ded4bbaa1dc747d98daee5a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.129839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc038514ded4bbaa1dc747d98daee5a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.136245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc038514ded4bbaa1dc747d98daee5a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.152115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc038514ded4bbaa1dc747d98daee5a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.172202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc038514ded4bbaa1dc747d98daee5a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.204699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 956/1910] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:04 2022] DELETE /identity/v3/users/fdc038514ded4bbaa1dc747d98daee5a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:05.220755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408514c7-16ba-43d0-b33f-ae250b026f77 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.309410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.310242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.310541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.310822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.313053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:05.387272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:05.388764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:05.423213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.425124 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.459672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 955/1911] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:05 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:05.489137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d6f2b-f109-4130-87f4-6344537c7ac0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.500290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.501858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.502604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.503047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] PATH_INFO: `/v3/projects/9b0c0ba248864026bc9eea3222d3fc52` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.504503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0c0ba248864026bc9eea3222d3fc52)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.507167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.596543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0c0ba248864026bc9eea3222d3fc52', 'request_id': 'req-40e5dc91-fbd5-420c-879c-f7a7b66b9479'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.611134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0c0ba248864026bc9eea3222d3fc52', 'request_id': 'req-40e5dc91-fbd5-420c-879c-f7a7b66b9479'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.618386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0c0ba248864026bc9eea3222d3fc52', 'request_id': 'req-40e5dc91-fbd5-420c-879c-f7a7b66b9479'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.633876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] The token cache is being invalidate because project 9b0c0ba248864026bc9eea3222d3fc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:05.634165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.640284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.642809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 957/1912] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:05 2022] DELETE /identity/v3/projects/9b0c0ba248864026bc9eea3222d3fc52 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:05.647136 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:05.660745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc1a39-a363-41d8-a12f-bdb1953069d8 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.715036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:05.715705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:05.753447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.754625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.754774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.755123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] PATH_INFO: `/v3/users/b60a8ce9d3474e8db945bf89b54439bd` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.756523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60a8ce9d3474e8db945bf89b54439bd)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.759162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.811592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5dc91-fbd5-420c-879c-f7a7b66b9479 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.817527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.818654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.819188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.819651 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] PATH_INFO: `/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.821224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3b56d4ddc94a85bfdc240acc3a6de1)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.824203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.830098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60a8ce9d3474e8db945bf89b54439bd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.830777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60a8ce9d3474e8db945bf89b54439bd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.831385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60a8ce9d3474e8db945bf89b54439bd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.842848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60a8ce9d3474e8db945bf89b54439bd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.857193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c2cc56-6043-414f-bbdf-7d33a5bb8615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60a8ce9d3474e8db945bf89b54439bd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.900270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 956/1913] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:05 2022] DELETE /identity/v3/users/b60a8ce9d3474e8db945bf89b54439bd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:05.901711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3b56d4ddc94a85bfdc240acc3a6de1', 'request_id': 'req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.919825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3b56d4ddc94a85bfdc240acc3a6de1', 'request_id': 'req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.938593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3b56d4ddc94a85bfdc240acc3a6de1', 'request_id': 'req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.951107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] The token cache is being invalidate because project 9e3b56d4ddc94a85bfdc240acc3a6de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:05.951399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.952291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:05.959587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 958/1914] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:05 2022] DELETE /identity/v3/projects/9e3b56d4ddc94a85bfdc240acc3a6de1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:05.966015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30120d-938a-4051-a775-3e211b00a330 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.966563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30120d-938a-4051-a775-3e211b00a330 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.967013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30120d-938a-4051-a775-3e211b00a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.988318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5a30120d-938a-4051-a775-3e211b00a330 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:05.989549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5a30120d-938a-4051-a775-3e211b00a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.248916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 957/1915] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:06.250092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.251480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.260002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.260764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.261337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.294715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:06.295725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.305224 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 958/1916] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:06.308921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.320865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a862c9-f5a7-4990-9507-f75aafe83a19 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.326774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.327450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.328543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.328814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.329781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:06.330225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.332102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.341174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acb9ad-15ad-499e-9c2f-f2b26cd4a95b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.346216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.347116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.347400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.347676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] PATH_INFO: `/v3/projects/7812bd6b90694affabb9a7673a1356a8` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.348907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7812bd6b90694affabb9a7673a1356a8)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.351123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.352835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 959/1917] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:02:06.353944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.364790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e340a5-84b3-4ab2-9fd5-e8c0c64d721f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.372776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.373770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.374111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.375247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.376541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.379258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.419277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7812bd6b90694affabb9a7673a1356a8', 'request_id': 'req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:06.421040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 960/1918] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:06.422657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.429135 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7812bd6b90694affabb9a7673a1356a8', 'request_id': 'req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:06.435991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7812bd6b90694affabb9a7673a1356a8', 'request_id': 'req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:06.449045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] The token cache is being invalidate because project 7812bd6b90694affabb9a7673a1356a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:06.449387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:06.450263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f003e4e0-80ee-4397-ab3a-8f42ff4c76b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:06.451864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 959/1919] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:06 2022] DELETE /identity/v3/projects/7812bd6b90694affabb9a7673a1356a8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:06.457639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae14df-55f3-41b1-8492-a46a17bb073c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.458865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae14df-55f3-41b1-8492-a46a17bb073c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.458865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae14df-55f3-41b1-8492-a46a17bb073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.481431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-60ae14df-55f3-41b1-8492-a46a17bb073c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:06.482908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-60ae14df-55f3-41b1-8492-a46a17bb073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.491311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185c479-c5ff-49bb-bd55-d853bf4b1ab0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.505961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 960/1920] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:06.509316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e29e0-05d2-4521-963c-622f7103440a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.509618 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e29e0-05d2-4521-963c-622f7103440a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.509925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e29e0-05d2-4521-963c-622f7103440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.511377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.511674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.515880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.516182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.516896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.518872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.532975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-234e29e0-05d2-4521-963c-622f7103440a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:06.534385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-234e29e0-05d2-4521-963c-622f7103440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.545105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 961/1921] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:06.549813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e29e0-05d2-4521-963c-622f7103440a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.562833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e29e0-05d2-4521-963c-622f7103440a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.564971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 961/1922] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:06.570201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.572255 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.574342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.574697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.574821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.575127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.576286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:06.577060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.579047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.591699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 962/1923] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:02:06.596004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.597655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8707a11-15b9-42b4-a743-e8d276cc3d76 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.603922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.605422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.605827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.606191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.607375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728946-a7db-490f-a32e-54f41c934757 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.607810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.610532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.614944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.615722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.616015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.616301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.616997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.619345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.633912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 962/1924] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:06.637575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.657718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 963/1925] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:06.661481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.668630 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85fa1-1a25-4ec1-92b6-b585c291ee50 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.750973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.751677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.752076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.752506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.753489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.755119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.773464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 963/1926] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:06.774664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.784986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00a36b-887a-43bc-98b6-ac5e0a0f82af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.785816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354b5e-7b0c-4051-9af9-c8bc272dd211 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.792194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.792366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.793154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.793572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.793881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.793984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] PATH_INFO: `/v3/projects/197a54fb84e5457c963067e7a6b9afde/users/8a956d4205b14021a8de76293fc6973e/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.794493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.795109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.795994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.799842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.810887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197a54fb84e5457c963067e7a6b9afde, user_id=8a956d4205b14021a8de76293fc6973e, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.814526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaa422-2020-4942-acbb-75f50d36e470 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.826746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 964/1927] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:06.832697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.841237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 964/1928] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:06 2022] PUT /identity/v3/projects/197a54fb84e5457c963067e7a6b9afde/users/8a956d4205b14021a8de76293fc6973e/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:06.847044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4b17b-ed90-4ce9-b077-375c818b9cc5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.854068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.854366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.854634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.900141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] MFA Rules not processed for user `8a956d4205b14021a8de76293fc6973e`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:06.907344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:06.929504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.930433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.931088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.931531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.932872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.938067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.952260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 965/1929] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:06.956608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:06.972579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48d9b-ddfd-4ba5-af72-53a4d92c8177 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:06.978472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:06.978786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:06.979195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:06.979553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:06.980488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:06.982217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:06.994381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 966/1930] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:06.999525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.000518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 965/1931] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:07.019296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84653ae-ac93-42b3-be5b-6fd40bb7e6b9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.025203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.026564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.027604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.028252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] PATH_INFO: `/v3/projects/863e39ec4cac4a2cb71e9402f28203e9/users/e817e534fe064101b0cf49fdb7f54df0/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.045190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.047420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:07.056545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863e39ec4cac4a2cb71e9402f28203e9, user_id=e817e534fe064101b0cf49fdb7f54df0, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.060055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.082484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 967/1932] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:06 2022] PUT /identity/v3/projects/863e39ec4cac4a2cb71e9402f28203e9/users/e817e534fe064101b0cf49fdb7f54df0/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:07.090747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.093265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:07.120297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62090146-b733-4947-8ddb-dd2e12cf9e0f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.161886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd4ce6-6444-4589-9526-cc8c068ecf93 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.165932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.166624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.166879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.167155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.168946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:07.176337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.177291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.177572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.177879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.239171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.240612 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c3a31-02f6-40e7-b928-0e17e7b66bd1 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.245400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.246904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.260194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 968/1933] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:07 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:07.269794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 966/1934] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:07 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:07.272467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.272930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.273367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.310076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] MFA Rules not processed for user `e817e534fe064101b0cf49fdb7f54df0`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:07.311565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:07.393067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 969/1935] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:07 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:07.397797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.497126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54527791-8bf4-4276-8e46-1ec94a883ab2 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.503259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.504251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.504478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.504852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.505658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.507703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.553407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 967/1936] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:07 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:07.558213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.577024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dff900-6ce2-43e0-8bae-0f7739185454 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.664473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.665448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.665881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.666262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.668097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.670620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.695672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 970/1937] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:07 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:07.699689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.710329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bdcaa-f362-4a4e-b5ce-42210675ea2d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.714881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.715551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.715834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.716110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.716859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.718553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.728862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 968/1938] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:07.733229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.745822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103e8a-1724-44d2-ae19-374590b884a0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.751623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.752639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.752995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.753344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] PATH_INFO: `/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b/users/e1dff3e5493b44fe9261ccf32d949d88/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.770418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9b8c16cb0c4eda951139c86f4f673b, user_id=e1dff3e5493b44fe9261ccf32d949d88, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.772919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.787709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 971/1939] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:07 2022] PUT /identity/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b/users/e1dff3e5493b44fe9261ccf32d949d88/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:07.791661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.801434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19ec7-f715-4e48-b8fd-51dca69ac050 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.854941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.855616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.855900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.856178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.856898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.858520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffcf46-7131-49fc-b38a-4fb5f16b92b9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.868025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 969/1940] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:07.872315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:07.882783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd14d1-0d8e-4fa0-9cfa-841a9147f2ee admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:07.887316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:07.888197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.888471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.888748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] PATH_INFO: `/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b/users/e1dff3e5493b44fe9261ccf32d949d88/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.891350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9b8c16cb0c4eda951139c86f4f673b, user_id=e1dff3e5493b44fe9261ccf32d949d88, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:07.894005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:07.903803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 972/1941] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:07 2022] PUT /identity/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b/users/e1dff3e5493b44fe9261ccf32d949d88/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:07.914695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff190-726a-44c8-8dee-dd3b7af9c156 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:07.914985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff190-726a-44c8-8dee-dd3b7af9c156 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:07.915259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff190-726a-44c8-8dee-dd3b7af9c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:07.941927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3a9ff190-726a-44c8-8dee-dd3b7af9c156 None None] MFA Rules not processed for user `e1dff3e5493b44fe9261ccf32d949d88`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:07.943121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3a9ff190-726a-44c8-8dee-dd3b7af9c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:08.010750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 970/1942] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:07 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:08.020659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:08.075759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01503-4d9f-4961-b7dc-5506e1a14398 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:08.079564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:08.080219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:08.080508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:08.080790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:08.137354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:08.138816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:08.147636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 973/1943] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:08 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:10.886202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3ec4-0e7e-4cd7-b468-efc148e31133 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:10.886673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3ec4-0e7e-4cd7-b468-efc148e31133 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:10.886759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3ec4-0e7e-4cd7-b468-efc148e31133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:10.904055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a91d3ec4-0e7e-4cd7-b468-efc148e31133 None None] MFA Rules not processed for user `9717e2ab2be74631aba4b196112bf984`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:10.905279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a91d3ec4-0e7e-4cd7-b468-efc148e31133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:10.957207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 971/1944] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:10 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:13.828676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:13.904333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5ba84-dfd7-477c-8e78-546cbdc53bf6 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:13.912375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:13.925468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:13.927302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:13.927599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] PATH_INFO: `/v3/users/e817e534fe064101b0cf49fdb7f54df0` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:13.931088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e817e534fe064101b0cf49fdb7f54df0)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:13.933023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.000141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e817e534fe064101b0cf49fdb7f54df0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.000581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e817e534fe064101b0cf49fdb7f54df0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.001184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e817e534fe064101b0cf49fdb7f54df0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.009394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e817e534fe064101b0cf49fdb7f54df0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.018031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e817e534fe064101b0cf49fdb7f54df0'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.040634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 974/1945] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:13 2022] DELETE /identity/v3/users/e817e534fe064101b0cf49fdb7f54df0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:14.045388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.046027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.046317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.068373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:14.069595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.149677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 972/1946] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:14.161897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.164203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.253413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54776-565a-4023-ab2d-936b4b9363b9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.262622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.263385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.263672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.263983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.288167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.289790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.313005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 975/1947] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:14.673340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.675367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.710510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05769a0-f8e0-44a2-bf8d-ea28e1887ea2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.720896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.722054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.722346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.722845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] PATH_INFO: `/v3/projects/863e39ec4cac4a2cb71e9402f28203e9` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.724058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=863e39ec4cac4a2cb71e9402f28203e9)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.726188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.790015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863e39ec4cac4a2cb71e9402f28203e9', 'request_id': 'req-57658d8c-d142-4e00-8d03-59ed126aa3cb'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.798629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863e39ec4cac4a2cb71e9402f28203e9', 'request_id': 'req-57658d8c-d142-4e00-8d03-59ed126aa3cb'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.806671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863e39ec4cac4a2cb71e9402f28203e9', 'request_id': 'req-57658d8c-d142-4e00-8d03-59ed126aa3cb'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.832332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] The token cache is being invalidate because project 863e39ec4cac4a2cb71e9402f28203e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:14.832802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.834831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.839857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 973/1948] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/projects/863e39ec4cac4a2cb71e9402f28203e9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:14.844747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.861193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284507d3-35d9-4c91-b09d-1fea51f8109a service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.941028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.941965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.942251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.942529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] PATH_INFO: `/v3/users/e1dff3e5493b44fe9261ccf32d949d88` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.943788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dff3e5493b44fe9261ccf32d949d88)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.945738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.035800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dff3e5493b44fe9261ccf32d949d88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.038124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dff3e5493b44fe9261ccf32d949d88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.039128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dff3e5493b44fe9261ccf32d949d88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.066123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dff3e5493b44fe9261ccf32d949d88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.079543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1cb0b817-f8ec-43a6-bc23-5f5a2708951b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dff3e5493b44fe9261ccf32d949d88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.101109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 976/1949] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/users/e1dff3e5493b44fe9261ccf32d949d88 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:15.522270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.523812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.542870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57658d8c-d142-4e00-8d03-59ed126aa3cb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.635044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.636045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.636398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.636744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] PATH_INFO: `/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.638035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9b8c16cb0c4eda951139c86f4f673b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.640019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.695102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9b8c16cb0c4eda951139c86f4f673b', 'request_id': 'req-df0fd443-4351-42ad-be1a-5e27be01bfe7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.708325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9b8c16cb0c4eda951139c86f4f673b', 'request_id': 'req-df0fd443-4351-42ad-be1a-5e27be01bfe7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.717232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9b8c16cb0c4eda951139c86f4f673b', 'request_id': 'req-df0fd443-4351-42ad-be1a-5e27be01bfe7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.741731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] The token cache is being invalidate because project 5a9b8c16cb0c4eda951139c86f4f673b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:15.742377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.743218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-df0fd443-4351-42ad-be1a-5e27be01bfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.745297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 974/1950] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:15 2022] DELETE /identity/v3/projects/5a9b8c16cb0c4eda951139c86f4f673b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:15.751808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.752067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.752342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.785253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:15.787297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.867037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 977/1951] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:15.875144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.875435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.875712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.896572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:15.898204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.912346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 975/1952] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:15.917175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.928098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502e0d-931c-432d-9875-03b6109512d4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.939405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.940093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.940375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.940806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.941766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:15.942246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.943997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.961560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 978/1953] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:15.966201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.976099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a618c-345f-4bc8-a595-9b12c4844273 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.987328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.988054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.988340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.988628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.989396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.993276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.058202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 976/1954] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:16.063164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.076839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2115c-b5ca-4595-9628-b49dfefe2845 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.143134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.143810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.144092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.144367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.145052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.146988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.169352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 979/1955] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:16.174163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.193498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4c46d-348e-44e4-967a-74e67a563f0a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.199080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.200060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.200607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.200806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.201545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.203220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.217298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 977/1956] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:16.221397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.232006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc765-4f24-4972-9a6d-6325da572aa7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.237333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.238163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.238455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.238940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.239614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.241288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a2ccc-aff4-468e-a79b-b61aeb4e1b0b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.251620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 980/1957] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:16.256551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.266694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14146550-7343-4ae0-ac5b-3849e4c6bb70 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.277386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.278450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.278876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.279152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] PATH_INFO: `/v3/projects/9a6d1227cf38441aba206831e5dac824/users/675eff9187e143a9be931379d113b7e2/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.302313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6d1227cf38441aba206831e5dac824, user_id=675eff9187e143a9be931379d113b7e2, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.305580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.324100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 978/1958] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:16 2022] PUT /identity/v3/projects/9a6d1227cf38441aba206831e5dac824/users/675eff9187e143a9be931379d113b7e2/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:16.334580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.334990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.335456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.372392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] MFA Rules not processed for user `675eff9187e143a9be931379d113b7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:16.373802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:16.474950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 981/1959] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:16.479607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.559964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a920-5ad8-4785-80fe-82a13e7937d0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.567433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.568305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.568755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.569036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.573288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.575324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.602536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 979/1960] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:16.606548 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.618593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734372d0-210e-4fd6-9c70-f2943e96e0df None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.679082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.679764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.680070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.680330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.681088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.683002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.703966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 982/1961] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:16.708602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.719567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f4b97-a203-4e69-bedb-ff913f45a1d5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.724176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.724845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.725127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.725403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.726145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.727716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.738590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 980/1962] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:16.742489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.752231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4b30-13c4-427a-bedc-59b74e1066a5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.757233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.758148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.758436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.758722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.759464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.761129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4abe2f-6d8c-4bef-97bc-9ca039a58aad admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.772399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 983/1963] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:16.776217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.786964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f874-7ffa-445e-b6a2-ed67542bc21b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.793256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.793944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.794058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.794284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] PATH_INFO: `/v3/projects/7cf988ce55d948f886a16549ef5264f0/users/6d80500074cb4a6c9a05178316f2a2ce/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.811728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf988ce55d948f886a16549ef5264f0, user_id=6d80500074cb4a6c9a05178316f2a2ce, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.814741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.828416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 981/1964] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:16 2022] PUT /identity/v3/projects/7cf988ce55d948f886a16549ef5264f0/users/6d80500074cb4a6c9a05178316f2a2ce/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:16.839710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.840214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.840587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.871598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] MFA Rules not processed for user `6d80500074cb4a6c9a05178316f2a2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:16.872945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:16.939397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 984/1965] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:16.943978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.002726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececc8b-0dcd-4a27-95da-1a1e87f52db1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.007514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.008186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.008470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.008748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.009463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.011396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.042387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 982/1966] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:17.043834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.054363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc118039-cdc4-4d18-b2bc-22a3487dd7f1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.109540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.110254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.110533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.110811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.111503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.113393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.137913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 985/1967] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:17 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:17.142481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.153415 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca553-4c37-45d8-9a50-33cc27ce815e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.163408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.164099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.164380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.164658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.165387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.167268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.177859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 983/1968] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:17.182154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.192053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ccc8-7c34-4483-af30-304ae70fb136 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.196777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.197660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.198126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.198404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] PATH_INFO: `/v3/projects/3af42f22cdef45e7849e1486dd80b23e/users/4e1752815ea44bb3bc34c1798786dca4/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.217049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af42f22cdef45e7849e1486dd80b23e, user_id=4e1752815ea44bb3bc34c1798786dca4, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.220520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.233472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.235142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 986/1969] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:17 2022] PUT /identity/v3/projects/3af42f22cdef45e7849e1486dd80b23e/users/4e1752815ea44bb3bc34c1798786dca4/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:17.236032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.238712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.252808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a153e8-8ec6-42f3-95af-2adccd148546 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.313271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec240-cc36-452f-80c5-a50d4aecf6f4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.320237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.321238 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.321484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.321782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] PATH_INFO: `/v3/users/8a956d4205b14021a8de76293fc6973e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.325164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a956d4205b14021a8de76293fc6973e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.325164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.327141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.328486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.328770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.329048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.329858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.331631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.345463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 987/1970] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:17.347196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.374084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39638d1-0797-4fbe-bb81-c2c6ab68a9a2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.386566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.387859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.389708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.389708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] PATH_INFO: `/v3/projects/3af42f22cdef45e7849e1486dd80b23e/users/4e1752815ea44bb3bc34c1798786dca4/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.398690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a956d4205b14021a8de76293fc6973e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:17.399636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a956d4205b14021a8de76293fc6973e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:17.401779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a956d4205b14021a8de76293fc6973e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:17.405458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af42f22cdef45e7849e1486dd80b23e, user_id=4e1752815ea44bb3bc34c1798786dca4, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.410733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a956d4205b14021a8de76293fc6973e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:17.413372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3662-78b3-4f88-9296-90a079f92252 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.420276 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-83c9cbef-d412-4512-bab7-b6902ca440ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a956d4205b14021a8de76293fc6973e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:17.444733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 988/1971] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:17 2022] PUT /identity/v3/projects/3af42f22cdef45e7849e1486dd80b23e/users/4e1752815ea44bb3bc34c1798786dca4/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:17.446116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 984/1972] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:17 2022] DELETE /identity/v3/users/8a956d4205b14021a8de76293fc6973e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:17.447006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.447302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.447630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.447730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.447934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.448216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.476019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:17.477266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.487438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] MFA Rules not processed for user `4e1752815ea44bb3bc34c1798786dca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:17.488622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.537547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 985/1973] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:17.547619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.549273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.561715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 989/1974] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:17 2022] POST /identity/v3/auth/tokens => generated 3464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:17.573307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.574864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.621453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8277-55b3-42e0-bf74-d7054725bc12 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.625710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.626391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.626669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.626942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.636690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.638263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.643721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b5caa-b2dc-4ee2-a501-186cc0986db9 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.647918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.648719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.649109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.649460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.650413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 986/1975] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:17.652250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.720826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.722342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc774ce1-0ae1-405a-9495-e1b3e7426cea service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.732253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 990/1976] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:17 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:18.028587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.033015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.062035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a083d34-e16e-4bbe-a33d-a01fb3e4a832 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.064991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.066491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.066970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.067337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] PATH_INFO: `/v3/projects/197a54fb84e5457c963067e7a6b9afde` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.068987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197a54fb84e5457c963067e7a6b9afde)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.071112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.117194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197a54fb84e5457c963067e7a6b9afde', 'request_id': 'req-0c4195aa-0352-43fd-a784-0ac273cc0c27'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:18.124702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197a54fb84e5457c963067e7a6b9afde', 'request_id': 'req-0c4195aa-0352-43fd-a784-0ac273cc0c27'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:18.130602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197a54fb84e5457c963067e7a6b9afde', 'request_id': 'req-0c4195aa-0352-43fd-a784-0ac273cc0c27'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:18.140430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] The token cache is being invalidate because project 197a54fb84e5457c963067e7a6b9afde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:18.140716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:18.141333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0c4195aa-0352-43fd-a784-0ac273cc0c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:18.142855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 987/1977] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:18 2022] DELETE /identity/v3/projects/197a54fb84e5457c963067e7a6b9afde => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:18.148970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.149434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.149536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.166934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:18.168117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.227609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 991/1978] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:18.235984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.236270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.236833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.254278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:18.255465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.263146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 988/1979] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:18.267407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.276709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f94f-962d-44d0-83f4-107f895f93e3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.281633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.282310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.282590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.282862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.283568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:18.283872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.285430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.297114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 992/1980] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:18.301393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.312379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc97a27-8e7d-4f05-ad18-0983fdca13f1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.317399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.318123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.318409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.318691 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.319375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.321263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.348833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 989/1981] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:18.352751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.363181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c5d0-0876-4d30-bd09-0fd9c4776d3c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.417141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.417840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.418123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.418399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.419088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.420981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.442175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 993/1982] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:18.446085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.456729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d4fa9-3517-4dbe-9ac2-139c69905805 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.461891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.462564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.462841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.463114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.463835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.465480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.478054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 990/1983] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:18.481779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.492231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e658be4-35a3-4a8b-98a1-6550030771fa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.501552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.502669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.503133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.503589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.505197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.507997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417eb1c-baf5-4144-bac2-63b55f0d6512 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.529366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 994/1984] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:18.531479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.542593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053e402-3860-4ab7-bc0f-eb1648c844b9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.548007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.548891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.549169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.549446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] PATH_INFO: `/v3/projects/c7d5cb675dfa4a03be524f27220be185/users/be81b80b15444cb5bc2c8b2b726f7566/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.564765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d5cb675dfa4a03be524f27220be185, user_id=be81b80b15444cb5bc2c8b2b726f7566, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.567423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.584724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 991/1985] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:18 2022] PUT /identity/v3/projects/c7d5cb675dfa4a03be524f27220be185/users/be81b80b15444cb5bc2c8b2b726f7566/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:18.596741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.597083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.597370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.625614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] MFA Rules not processed for user `be81b80b15444cb5bc2c8b2b726f7566`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:18.626900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.696667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 995/1986] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:18.708377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.710151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.777331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70b8d-2817-4e90-ad66-cc6b4bb4b518 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.781580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.782258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.782543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.782826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.791306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.792720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.801159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 992/1987] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:18 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:19.295415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:19.305551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331bfda-30ec-400a-a23a-bebcc7f20946 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:19.309631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:19.310400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:19.310757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:19.311108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:19.313789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:19.371748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:19.373325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:19.383504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 996/1988] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:19.957908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:19.966568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd53728-2182-4cfc-ba72-dd78cd48cbac service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:19.972594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:19.973388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:19.973812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:19.974195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:19.976123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:20.065166 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:20.070558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:20.085036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 993/1989] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:26.070382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:26.072188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:26.142550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565fb2-171e-40c9-ad5f-ee1cbc1c564c service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:26.147184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:26.148051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:26.148338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:26.148617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] PATH_INFO: `/v3/users/2acdc4274c2145509d27e84c7335d006` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:26.149823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acdc4274c2145509d27e84c7335d006)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:26.151734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:26.194294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acdc4274c2145509d27e84c7335d006'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.194926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acdc4274c2145509d27e84c7335d006'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.195528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acdc4274c2145509d27e84c7335d006'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.203587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acdc4274c2145509d27e84c7335d006'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.210113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acdc4274c2145509d27e84c7335d006'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.226450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 997/1990] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:26 2022] DELETE /identity/v3/users/2acdc4274c2145509d27e84c7335d006 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:26.461098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:26.488426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b42655-45bc-4a03-b4c6-a1eb8c12bde1 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:26.541959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:26.542831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:26.543111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:26.543393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] PATH_INFO: `/v3/projects/8d1720fe5a1041c9977376e01863188e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:26.544547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1720fe5a1041c9977376e01863188e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:26.546504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:26.592688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1720fe5a1041c9977376e01863188e', 'request_id': 'req-beb94afe-8ccb-42da-b9bd-18dff30482ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.599332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1720fe5a1041c9977376e01863188e', 'request_id': 'req-beb94afe-8ccb-42da-b9bd-18dff30482ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.605390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1720fe5a1041c9977376e01863188e', 'request_id': 'req-beb94afe-8ccb-42da-b9bd-18dff30482ec'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.615518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] The token cache is being invalidate because project 8d1720fe5a1041c9977376e01863188e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:26.615811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.616434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.617994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 994/1991] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:26 2022] DELETE /identity/v3/projects/8d1720fe5a1041c9977376e01863188e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:26.621898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:26.623293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:26.636170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460cc9a-6f8a-4702-a3aa-fa5ef1d049de admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:26.690610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:26.691473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:26.691754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:26.692025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] PATH_INFO: `/v3/users/6e9cb1da3b014bb1bf1186de493a2f88` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:26.693190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9cb1da3b014bb1bf1186de493a2f88)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:26.695145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:26.738471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9cb1da3b014bb1bf1186de493a2f88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.739132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9cb1da3b014bb1bf1186de493a2f88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.739739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9cb1da3b014bb1bf1186de493a2f88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.747412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9cb1da3b014bb1bf1186de493a2f88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.754759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ba2f1e97-9653-4971-a796-1bb29ebe83e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9cb1da3b014bb1bf1186de493a2f88'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:26.775505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 998/1992] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:26 2022] DELETE /identity/v3/users/6e9cb1da3b014bb1bf1186de493a2f88 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:26.945375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:26.946930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:26.959344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94afe-8ccb-42da-b9bd-18dff30482ec admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.017930 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.018979 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.019746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.020178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] PATH_INFO: `/v3/projects/0d2a985f9ef84085b886cbd344a0709a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.021678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2a985f9ef84085b886cbd344a0709a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.023798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.070367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2a985f9ef84085b886cbd344a0709a', 'request_id': 'req-02aa30f3-86de-4da1-8146-c24495b7b8cd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.077544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2a985f9ef84085b886cbd344a0709a', 'request_id': 'req-02aa30f3-86de-4da1-8146-c24495b7b8cd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.084051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2a985f9ef84085b886cbd344a0709a', 'request_id': 'req-02aa30f3-86de-4da1-8146-c24495b7b8cd'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.095814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] The token cache is being invalidate because project 0d2a985f9ef84085b886cbd344a0709a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:27.096105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.096814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02aa30f3-86de-4da1-8146-c24495b7b8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.099040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 995/1993] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:26 2022] DELETE /identity/v3/projects/0d2a985f9ef84085b886cbd344a0709a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:27.105857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.106285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.106417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.127904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:27.129123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:27.197048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 999/1994] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:27.205025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.205252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.205530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.225255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:27.226483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:27.235219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 996/1995] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:27.239309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.250688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b364-75e1-4d77-899c-f0ccc6197504 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.253817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.254490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.254927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.255215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.256035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:27.256239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.257857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.269923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1000/1996] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:27.275281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.284704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135637e0-60bd-40c9-8bed-3ab457c35f6e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.289282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.289972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.290253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.290527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.291202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.293065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.317052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 997/1997] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:27 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:27.321110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.330956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566002d0-3b08-4bb6-8d79-7e9ce06fe8bf admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.385539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.386244 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.386532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.386812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.387510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.389406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.407762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1001/1998] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:27 2022] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:27.411959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.422380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365300a-dd63-47dc-b9fb-0e010b58bbed admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.426855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.427511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.427792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.428066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.428805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.430423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.440617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 998/1999] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:27.444516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.455960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a20b-6118-490e-a67e-1a8a63b3a93d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.460620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.461301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.461586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.463190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.463930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.466270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3c1d-ff20-4b3c-b04c-ebebb902ee08 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.480951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1002/2000] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:27.485184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.494957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da7f2-a7db-4602-9568-84e4e1f8dd1e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.499496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.500477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.500759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.501040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] PATH_INFO: `/v3/projects/a347ae61ad124e1e9038751eaa4413ba/users/a1faf897c3c342a6b42bb58dbc23469a/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.515540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a347ae61ad124e1e9038751eaa4413ba, user_id=a1faf897c3c342a6b42bb58dbc23469a, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.518188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.532350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 999/2001] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:27 2022] PUT /identity/v3/projects/a347ae61ad124e1e9038751eaa4413ba/users/a1faf897c3c342a6b42bb58dbc23469a/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:27.543199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.543492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.543772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.570828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] MFA Rules not processed for user `a1faf897c3c342a6b42bb58dbc23469a`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:27.572038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:27.633640 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1003/2002] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:27 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:27.645509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.647205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:27.705692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57e357-a8e7-4107-aea1-9abad961f638 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.709386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.710014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.710295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.710572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.719270 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.720676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cbcf7-6f5e-4616-a81d-c1abde8e1939 service glance] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.729213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1000/2003] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:27 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:30.332363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:30.333868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:30.398247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684c28-cf33-4e35-9a40-3b40da892ceb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:30.402939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:30.403808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:30.404087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:30.404363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] PATH_INFO: `/v3/users/675eff9187e143a9be931379d113b7e2` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:30.405567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675eff9187e143a9be931379d113b7e2)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:30.407535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:30.454225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675eff9187e143a9be931379d113b7e2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:30.454878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675eff9187e143a9be931379d113b7e2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:30.455477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675eff9187e143a9be931379d113b7e2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:30.462073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675eff9187e143a9be931379d113b7e2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:30.468756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675eff9187e143a9be931379d113b7e2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:30.486099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1004/2004] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:30 2022] DELETE /identity/v3/users/675eff9187e143a9be931379d113b7e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:30.490627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:30.491170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:30.491170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:30.508848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:30.510085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:30.581911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1001/2005] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:30.585617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:30.587101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:30.647735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8420f23-6235-4269-84f5-a7a3168b8056 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:30.658058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:30.658753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:30.659069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:30.659352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:30.669780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:30.671273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:30.681949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1005/2006] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:31.239420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:31.254951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:31.269341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e65a5-5822-4648-b17a-89b040474799 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:31.277054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:31.278181 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:31.278638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:31.279070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] PATH_INFO: `/v3/projects/9a6d1227cf38441aba206831e5dac824` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:31.280548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6d1227cf38441aba206831e5dac824)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:31.282844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:31.341868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6d1227cf38441aba206831e5dac824', 'request_id': 'req-04c4f9bd-34ee-414f-a935-49a5340b1ec5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.357600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6d1227cf38441aba206831e5dac824', 'request_id': 'req-04c4f9bd-34ee-414f-a935-49a5340b1ec5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.375271 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6d1227cf38441aba206831e5dac824', 'request_id': 'req-04c4f9bd-34ee-414f-a935-49a5340b1ec5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.408906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] The token cache is being invalidate because project 9a6d1227cf38441aba206831e5dac824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:31.409207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.409950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.416790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1002/2007] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:31 2022] DELETE /identity/v3/projects/9a6d1227cf38441aba206831e5dac824 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:31.422290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:31.438678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53bfba-84c8-4fbc-910b-6b64270a420c service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:31.515376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:31.516415 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:31.516792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:31.516961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] PATH_INFO: `/v3/users/6d80500074cb4a6c9a05178316f2a2ce` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:31.518427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d80500074cb4a6c9a05178316f2a2ce)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:31.520540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:31.583790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d80500074cb4a6c9a05178316f2a2ce'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.585219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d80500074cb4a6c9a05178316f2a2ce'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.585938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d80500074cb4a6c9a05178316f2a2ce'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.593726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d80500074cb4a6c9a05178316f2a2ce'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.600803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d80500074cb4a6c9a05178316f2a2ce'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:31.618516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1006/2008] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:31 2022] DELETE /identity/v3/users/6d80500074cb4a6c9a05178316f2a2ce => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:31.914662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:31.916396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:31.934741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f9bd-34ee-414f-a935-49a5340b1ec5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:31.991208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:31.992074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:31.992351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:31.992624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] PATH_INFO: `/v3/projects/7cf988ce55d948f886a16549ef5264f0` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:31.993818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf988ce55d948f886a16549ef5264f0)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:31.995696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:32.040133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf988ce55d948f886a16549ef5264f0', 'request_id': 'req-af5e38a7-2eb9-4d5c-8199-158e8f960b19'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.047429 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf988ce55d948f886a16549ef5264f0', 'request_id': 'req-af5e38a7-2eb9-4d5c-8199-158e8f960b19'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.053912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf988ce55d948f886a16549ef5264f0', 'request_id': 'req-af5e38a7-2eb9-4d5c-8199-158e8f960b19'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.065176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] The token cache is being invalidate because project 7cf988ce55d948f886a16549ef5264f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:32.065466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.066152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.067673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1003/2009] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:31 2022] DELETE /identity/v3/projects/7cf988ce55d948f886a16549ef5264f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:32.071635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:32.073104 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:32.085642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325c2b-e4f6-4a62-800b-45052fe12231 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:32.143871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:32.144790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.145071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.145372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] PATH_INFO: `/v3/users/4e1752815ea44bb3bc34c1798786dca4` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.146553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1752815ea44bb3bc34c1798786dca4)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:32.148459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:32.195771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1752815ea44bb3bc34c1798786dca4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.196436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1752815ea44bb3bc34c1798786dca4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.197099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1752815ea44bb3bc34c1798786dca4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.204136 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1752815ea44bb3bc34c1798786dca4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.211038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c70e25df-ec40-4da2-a13f-715104693e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1752815ea44bb3bc34c1798786dca4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.229722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1007/2010] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:32 2022] DELETE /identity/v3/users/4e1752815ea44bb3bc34c1798786dca4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:32.495870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:32.497584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:32.523409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e38a7-2eb9-4d5c-8199-158e8f960b19 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:32.582061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:32.582940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.583660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.583660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] PATH_INFO: `/v3/projects/3af42f22cdef45e7849e1486dd80b23e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.584676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af42f22cdef45e7849e1486dd80b23e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:32.586603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:32.636700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af42f22cdef45e7849e1486dd80b23e', 'request_id': 'req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.644831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af42f22cdef45e7849e1486dd80b23e', 'request_id': 'req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.651932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af42f22cdef45e7849e1486dd80b23e', 'request_id': 'req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.663707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] The token cache is being invalidate because project 3af42f22cdef45e7849e1486dd80b23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:32.664012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.664757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c6793fcf-a1f7-4d44-9265-4b20b65e7a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:32.666390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1004/2011] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:32 2022] DELETE /identity/v3/projects/3af42f22cdef45e7849e1486dd80b23e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:32.673052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.673514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.673514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.691985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:32.693206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:32.766660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1008/2012] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:32.777712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.777712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.777712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.799176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:32.800393 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:32.808480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1005/2013] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:32.813196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:32.824800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ed739-052a-4a7e-bfda-9c8704436db3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:32.829725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:32.830500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.830788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.831064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.831792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:32.832143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:32.833807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:32.845979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1009/2014] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:32.850486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:32.861782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0a94-d5dd-4bdb-9b18-b6f192051fce None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:32.867472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:32.868149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.868436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.868717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.869419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:32.871350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:32.904562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1006/2015] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:32 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:32.906570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:32.918450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dda42-a1ea-44cf-a27d-2baca959d920 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:32.988978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:32.989714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:32.990033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:32.990335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:32.991027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:32.992927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:33.015556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1010/2016] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:32 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:33.018666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:33.028947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bc06c-7119-4c4b-a0e1-3325da6614b3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:33.034884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:33.035923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.036278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.036631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.037433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:33.039565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:33.053009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1007/2017] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:33.054207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:33.065269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977a85-0411-4d29-beb9-1c98e3ddeb38 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:33.069923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:33.070584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.070867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.071141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.071897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:33.073587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1f518-2abc-4aa2-84d9-058db745c2f0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:33.084988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1011/2018] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:33.089887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:33.100968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6ce85-079d-4823-a596-216d532bb9c1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:33.105951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:33.106844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.107139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.107408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] PATH_INFO: `/v3/projects/d5fadacda75f4056a87305cf132ac42f/users/f465767b87c1447aa184f222b6fce9f7/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.123791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fadacda75f4056a87305cf132ac42f, user_id=f465767b87c1447aa184f222b6fce9f7, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:33.127292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:33.141232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1008/2019] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:33 2022] PUT /identity/v3/projects/d5fadacda75f4056a87305cf132ac42f/users/f465767b87c1447aa184f222b6fce9f7/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:33.151303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7d7f-34e5-4ec8-856e-8ff3d4871069 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.151595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7d7f-34e5-4ec8-856e-8ff3d4871069 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.151930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7d7f-34e5-4ec8-856e-8ff3d4871069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.177681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-e41d7d7f-34e5-4ec8-856e-8ff3d4871069 None None] MFA Rules not processed for user `f465767b87c1447aa184f222b6fce9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:33.178915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e41d7d7f-34e5-4ec8-856e-8ff3d4871069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:33.247015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1012/2020] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:33 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:33.257521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:33.259391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:33.317384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af518c5e-a5c6-4b05-8430-b1d1a20b49e5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:33.322045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:33.322821 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.323105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.323381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.334524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:33.335968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:33.344770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1009/2021] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:33 2022] GET /identity/v3/auth/tokens => generated 3409 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:37.283436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:37.283985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:37.283985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:37.302758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] MFA Rules not processed for user `9717e2ab2be74631aba4b196112bf984`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:37.304073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:37.359366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1013/2022] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:37 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:39.131024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.132471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:39.196105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5f5eb-1d71-49c6-a32c-7e972fcafc5d service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.200576 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.201446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.201731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.202039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] PATH_INFO: `/v3/users/3bf94c1b148942939821bdd801d4f907` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.203837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf94c1b148942939821bdd801d4f907)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.205736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.247329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf94c1b148942939821bdd801d4f907'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.247950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf94c1b148942939821bdd801d4f907'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.248557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf94c1b148942939821bdd801d4f907'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.256743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf94c1b148942939821bdd801d4f907'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.264619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-81c412a5-6a11-4786-8bdf-bbfe2c472053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf94c1b148942939821bdd801d4f907'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.283378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1010/2023] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:39 2022] DELETE /identity/v3/users/3bf94c1b148942939821bdd801d4f907 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:39.454331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.473670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452999eb-5b0a-4e17-b304-d51566279323 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.554087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.554946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.555226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.555503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] PATH_INFO: `/v3/projects/e903984909674521a44fe37d95d94b8c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.556665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e903984909674521a44fe37d95d94b8c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.558581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.603795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e903984909674521a44fe37d95d94b8c', 'request_id': 'req-f4cfff04-a132-4752-9bc8-4f80e3af9644'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.610720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e903984909674521a44fe37d95d94b8c', 'request_id': 'req-f4cfff04-a132-4752-9bc8-4f80e3af9644'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.615972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e903984909674521a44fe37d95d94b8c', 'request_id': 'req-f4cfff04-a132-4752-9bc8-4f80e3af9644'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.627070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] The token cache is being invalidate because project e903984909674521a44fe37d95d94b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:39.627359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.627999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f4cfff04-a132-4752-9bc8-4f80e3af9644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:39.629524 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1014/2024] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:39 2022] DELETE /identity/v3/projects/e903984909674521a44fe37d95d94b8c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:39.635289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.635586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.635871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.653290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:39.654541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:39.712601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1011/2025] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:39.722847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.723140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.723621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.741656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:39.742881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:39.751302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1015/2026] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:39.755300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.764802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da0ee5-23b2-4ff6-98f0-96e708c44344 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.769359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.770063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.770347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.770650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.771369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:39.771706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.773288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.784854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1012/2027] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:02:39.788849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.798370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df639938-0ec5-4f98-b0f4-b3395bebb404 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.802965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.803611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.803898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.804176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.804854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.806773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.830912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1016/2028] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:39 2022] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:39.835097 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.845063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c940-e6ee-404d-8323-ecd17f0ba3da admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.898105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.898779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.899059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.899334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.900023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.901921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.925087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1013/2029] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:39 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:39.929210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.939988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725a2d1-3e0e-45a1-8004-e2ac40411b19 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.944760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.945446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.945729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.946034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.946743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.948313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.959054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1017/2030] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:39.963054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:39.974417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45880-5e10-4419-96a3-92649eaa4404 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:39.983169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:39.984463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:39.984745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:39.985020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:39.985735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:39.987354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb709502-f3ef-4712-8849-8cbae325389c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:39.997269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1014/2031] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:40.001225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:40.010893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362aab0-8132-44d3-9df0-2438814a7182 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:40.015558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:40.016424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.016704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.016978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] PATH_INFO: `/v3/projects/8b253c97f9094f0eafdc4fec85233ee5/users/545baa644eea43be8be9050653e89000/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.031100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b253c97f9094f0eafdc4fec85233ee5, user_id=545baa644eea43be8be9050653e89000, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:40.033699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:40.047350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1018/2032] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:40 2022] PUT /identity/v3/projects/8b253c97f9094f0eafdc4fec85233ee5/users/545baa644eea43be8be9050653e89000/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:40.057312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.057627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.057946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.083656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] MFA Rules not processed for user `545baa644eea43be8be9050653e89000`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:40.084890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:40.146998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1015/2033] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:40 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:40.170300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:40.173624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:40.243967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363b1b-7c9c-49e2-ac2e-a2483f1fbf44 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:40.249413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:40.250096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.250384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.250664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.258358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:40.259959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a1539-fd23-4378-a0a8-5ac31de99e59 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:40.269181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1019/2034] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:40.438470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:40.497240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cff0d-3ecd-4f34-a158-fdc208dfe2e5 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:40.501617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:40.502505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.502793 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.503072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] PATH_INFO: `/v3/users/545baa644eea43be8be9050653e89000` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.504242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545baa644eea43be8be9050653e89000)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:40.506177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:40.549056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545baa644eea43be8be9050653e89000'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:40.549704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545baa644eea43be8be9050653e89000'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:40.550618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545baa644eea43be8be9050653e89000'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:40.557633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545baa644eea43be8be9050653e89000'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:40.565051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545baa644eea43be8be9050653e89000'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:40.583838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1016/2035] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:40 2022] DELETE /identity/v3/users/545baa644eea43be8be9050653e89000 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:40.588410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.588863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.588971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.606355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:40.608412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:40.665036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1020/2036] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:40 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:40.674986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:40.676598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:40.730449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38876-86ad-4614-9b23-5bd86dd82039 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:40.734152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:40.734812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.735227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.735514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.744674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:40.746165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caceca6c-5f63-4d60-81e0-ddbfb547e2cc service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:40.756163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1017/2037] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:41.082119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.083606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:41.096014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea018e-6fa1-4dac-995c-8c8010983edf None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.101515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.102816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.103165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.103495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] PATH_INFO: `/v3/projects/8b253c97f9094f0eafdc4fec85233ee5` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.104699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b253c97f9094f0eafdc4fec85233ee5)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.106743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.151080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b253c97f9094f0eafdc4fec85233ee5', 'request_id': 'req-dd11b96a-bc44-48c2-8d6a-047bd3062c30'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:41.158662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b253c97f9094f0eafdc4fec85233ee5', 'request_id': 'req-dd11b96a-bc44-48c2-8d6a-047bd3062c30'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:41.163814 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b253c97f9094f0eafdc4fec85233ee5', 'request_id': 'req-dd11b96a-bc44-48c2-8d6a-047bd3062c30'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:41.174945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] The token cache is being invalidate because project 8b253c97f9094f0eafdc4fec85233ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:41.175237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:41.175879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-dd11b96a-bc44-48c2-8d6a-047bd3062c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:41.177407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1021/2038] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:41 2022] DELETE /identity/v3/projects/8b253c97f9094f0eafdc4fec85233ee5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:41.183083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.183563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.183773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.205267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:41.206587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:41.265847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1018/2039] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:41.274134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.274134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.274320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.292722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:41.293952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:41.302343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1022/2040] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:41.306628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.316285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8fa29-0788-42d0-9c88-4128ed0e7a96 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.320773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.321436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.321726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.322036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.322757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:41.323074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.324665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.335699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1019/2041] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:41.339652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.348989 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31690f13-0fb4-4c5e-a0fb-651d39d25e22 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.353515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.354190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.354474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.354745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.355418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.357346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.382728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1023/2042] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:41.386840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.396481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691e22-9fd1-4004-8ff2-332114af5551 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.450496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.451158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.451445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.451751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.452430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.454351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.473800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1020/2043] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:41.478019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.488669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009544d-e87f-42b3-9f5e-4505ccf9a0ed admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.493385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.494084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.494373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.494653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.495382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.496954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.507023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1024/2044] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:41.510678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.520370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051784-c43e-465b-8104-0bf5b9f9cd80 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.524834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.525505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.525807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.526094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.526812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.528381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48c27-f75a-42ea-abf4-e0c1f8959d6b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.538375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1021/2045] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:41.542319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.552533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605abb2-75d2-461a-a25b-e00c62310375 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.557257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.558156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.558443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.558734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] PATH_INFO: `/v3/projects/3666055374f5485d9e9c9f9177c3dccc/users/cd900584837a4618842d32de567395f5/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.572795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3666055374f5485d9e9c9f9177c3dccc, user_id=cd900584837a4618842d32de567395f5, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.575459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.587837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1025/2046] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:41 2022] PUT /identity/v3/projects/3666055374f5485d9e9c9f9177c3dccc/users/cd900584837a4618842d32de567395f5/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:41.599585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.599878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.600161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.626940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] MFA Rules not processed for user `cd900584837a4618842d32de567395f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:41.628199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:41.690363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1022/2047] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:41.694972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.752405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ac69-a533-4529-80ff-11619988c702 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.756980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.757630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.757939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.758222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.758908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.760792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.785174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1026/2048] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:41.789397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.799762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef764-1ab8-4b7c-ab8d-e16d9669e53d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.854350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.855023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.855306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.855582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.856281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.858279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.876623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1023/2049] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:41 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:41.880998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.891592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d27d2-56f6-47a4-a3f4-ce3603a815c5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.896293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.896966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.897234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.897513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.898264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.899879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.910667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1027/2050] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:41.914347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.923846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c566870-89b7-4e7c-8152-82301ef3395c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:41.928398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:41.929284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:41.929568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:41.929876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] PATH_INFO: `/v3/projects/8006f3f6db6342baac9aaca4ec58ad81/users/374496db7e92494093fed34bb9511d92/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:41.944133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8006f3f6db6342baac9aaca4ec58ad81, user_id=374496db7e92494093fed34bb9511d92, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.946784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.960496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1024/2051] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:41 2022] PUT /identity/v3/projects/8006f3f6db6342baac9aaca4ec58ad81/users/374496db7e92494093fed34bb9511d92/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:41.964453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:41.975260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8595-8e7a-4540-aeec-afaf8a3ccc73 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:42.067809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:42.068675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:42.069103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:42.069852 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:42.071385 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:42.074215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a76d1-37b7-46ed-b579-d3fdf9a2174b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:42.098220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1028/2052] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:42.099471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:42.110893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9c6d2-c713-4bcd-a671-f0052faf7b0b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:42.115597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:42.116477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:42.116761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:42.117036 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] PATH_INFO: `/v3/projects/8006f3f6db6342baac9aaca4ec58ad81/users/374496db7e92494093fed34bb9511d92/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:42.119058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8006f3f6db6342baac9aaca4ec58ad81, user_id=374496db7e92494093fed34bb9511d92, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:42.121674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:42.132440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1025/2053] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:42 2022] PUT /identity/v3/projects/8006f3f6db6342baac9aaca4ec58ad81/users/374496db7e92494093fed34bb9511d92/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:42.143221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:42.143511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:42.143793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:42.287474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] MFA Rules not processed for user `374496db7e92494093fed34bb9511d92`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:42.288711 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:42.355289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1029/2054] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:42 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:42.368953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:42.370606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:42.425542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d2c50-f7d9-40c4-b9f8-63f72ac78501 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:42.429093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:42.429733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:42.430040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:42.430315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:42.439966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:42.441556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:42.451570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1026/2055] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:42 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:42.522639 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:42.531923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12876b15-78d3-4f05-874f-6b962d23e13f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:42.535520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:42.536154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:42.536435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:42.536714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:42.599199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:42.601988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930c32c-3b57-47d7-b4ce-663954abc056 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:42.613162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1030/2056] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:42 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:48.199476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:48.200880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:48.266263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368b0d-8002-4224-8bd2-aec319b48614 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:48.272657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:48.273548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:48.273861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:48.274165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] PATH_INFO: `/v3/users/be81b80b15444cb5bc2c8b2b726f7566` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:48.275356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=be81b80b15444cb5bc2c8b2b726f7566)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:48.277345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:48.324225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be81b80b15444cb5bc2c8b2b726f7566'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.324866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be81b80b15444cb5bc2c8b2b726f7566'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.325458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be81b80b15444cb5bc2c8b2b726f7566'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.333519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be81b80b15444cb5bc2c8b2b726f7566'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.340413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be81b80b15444cb5bc2c8b2b726f7566'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.357412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1027/2057] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:48 2022] DELETE /identity/v3/users/be81b80b15444cb5bc2c8b2b726f7566 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:48.362467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:48.362911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:48.363021 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:48.381483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:48.382024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:48.471140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1031/2058] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:48.483095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:48.484864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:48.548120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a2479-0783-4e5d-8e06-5330767c06ee admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:48.552317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:48.553100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:48.553390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:48.553780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:48.563692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:48.565144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fe092-9b66-4ca9-bf29-d7eeba717a90 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:48.574495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1028/2059] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:48.831223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:48.832682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:48.846413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5777-2785-406c-a50b-6921abaa07c6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:48.851243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:48.852141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:48.852418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:48.852694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] PATH_INFO: `/v3/projects/c7d5cb675dfa4a03be524f27220be185` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:48.853908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d5cb675dfa4a03be524f27220be185)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:48.856006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:48.903901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d5cb675dfa4a03be524f27220be185', 'request_id': 'req-147176f4-7dba-4d64-ad7b-c5152f89c779'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.911877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d5cb675dfa4a03be524f27220be185', 'request_id': 'req-147176f4-7dba-4d64-ad7b-c5152f89c779'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.917446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d5cb675dfa4a03be524f27220be185', 'request_id': 'req-147176f4-7dba-4d64-ad7b-c5152f89c779'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.928471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] The token cache is being invalidate because project c7d5cb675dfa4a03be524f27220be185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:48.928755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.929386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-147176f4-7dba-4d64-ad7b-c5152f89c779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:48.931119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1032/2060] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:48 2022] DELETE /identity/v3/projects/c7d5cb675dfa4a03be524f27220be185 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:48.936751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:48.937292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:48.937564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:48.955034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:48.956253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:49.013972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1029/2061] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:49.022080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.022438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.022811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.042063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:49.043262 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:49.051596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1033/2062] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:49.055677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.065287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8388d3-dba9-4d43-bacc-cd447da16e35 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.069728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a439-a166-4797-bf48-879453daddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.070579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a439-a166-4797-bf48-879453daddac admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.070863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a439-a166-4797-bf48-879453daddac admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.071138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a439-a166-4797-bf48-879453daddac admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.071958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a439-a166-4797-bf48-879453daddac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:49.072266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a439-a166-4797-bf48-879453daddac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.073865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a439-a166-4797-bf48-879453daddac admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.084772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1030/2063] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:49.088597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.098037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3abd-7786-496d-af00-650accf1b8cb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.102659 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.103306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.103586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.103857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.104542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.106448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.134859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1034/2064] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:49 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:49.136203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a439-a166-4797-bf48-879453daddac admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.145924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a439-a166-4797-bf48-879453daddac admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.200081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.200769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.201032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.201315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.202549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.204491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.224546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1031/2065] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:49 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:49.228562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.238816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4248c15-4db4-4311-89b4-f3a29dcb3dc5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.243447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.244103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.244396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.244669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.245390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.247070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.257382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1035/2066] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:49.261487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.271881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1a6d0-0fab-4599-8dbd-041413cd789a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.276656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.277339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.277591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.277901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.278615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.280790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e2ca-cb5e-4c5b-8f6a-c1e8c14554a0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.290330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1032/2067] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:49.294586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.304288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45238e-f91c-4ad9-9248-865e82fd544f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.308860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.309728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.310048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.310325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] PATH_INFO: `/v3/projects/db6ea7ebf03d4ba89b2158cb1610b391/users/1f85e8545e634ff99938a4c9dfa1bd2c/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.324287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6ea7ebf03d4ba89b2158cb1610b391, user_id=1f85e8545e634ff99938a4c9dfa1bd2c, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.327516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.339803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1036/2068] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:49 2022] PUT /identity/v3/projects/db6ea7ebf03d4ba89b2158cb1610b391/users/1f85e8545e634ff99938a4c9dfa1bd2c/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:49.345432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52843-c7ad-427e-95e6-9bdbb9b382db None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.345723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52843-c7ad-427e-95e6-9bdbb9b382db None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.346033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b52843-c7ad-427e-95e6-9bdbb9b382db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.363007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-19b52843-c7ad-427e-95e6-9bdbb9b382db None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:49.364203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-19b52843-c7ad-427e-95e6-9bdbb9b382db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:49.421603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1033/2069] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:49.431543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:49.433367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:49.487959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e4982-6214-4b4e-904f-39b4a5d60428 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:49.491631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:49.492264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:49.492546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:49.492824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:49.501480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:49.502939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:49.511986 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1037/2070] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:50.105852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820c48c-db5b-442a-be79-a781d6cba30c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:50.106162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820c48c-db5b-442a-be79-a781d6cba30c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:50.106419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820c48c-db5b-442a-be79-a781d6cba30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:50.136426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7820c48c-db5b-442a-be79-a781d6cba30c None None] MFA Rules not processed for user `1f85e8545e634ff99938a4c9dfa1bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:50.137216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7820c48c-db5b-442a-be79-a781d6cba30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:50.208326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1034/2071] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:50 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:50.218129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:50.219637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:50.283512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e55a-cebd-42ad-94d5-54eef34dba4f service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:50.288410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:50.289061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:50.289344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:50.289619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:50.299075 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:50.300707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:50.309863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1038/2072] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:50 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:55.857288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710cfd0-f2d8-4ea8-990b-57bbdd7e37b9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:55.857794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710cfd0-f2d8-4ea8-990b-57bbdd7e37b9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:55.857996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710cfd0-f2d8-4ea8-990b-57bbdd7e37b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:55.875484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e710cfd0-f2d8-4ea8-990b-57bbdd7e37b9 None None] MFA Rules not processed for user `1f85e8545e634ff99938a4c9dfa1bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:55.876672 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e710cfd0-f2d8-4ea8-990b-57bbdd7e37b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:55.883811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1035/2073] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:02:55 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:02.116165 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:02.117601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.131807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fb209-726d-489c-a893-8e2f9983398a service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:02.136387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:02.137256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.137541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.137845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] PATH_INFO: `/v3/users/f465767b87c1447aa184f222b6fce9f7` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.139022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f465767b87c1447aa184f222b6fce9f7)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:02.140914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:02.187519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f465767b87c1447aa184f222b6fce9f7'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:02.188166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f465767b87c1447aa184f222b6fce9f7'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:02.188759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f465767b87c1447aa184f222b6fce9f7'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:02.198838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f465767b87c1447aa184f222b6fce9f7'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:02.207282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f465767b87c1447aa184f222b6fce9f7'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:02.225022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1039/2074] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:02 2022] DELETE /identity/v3/users/f465767b87c1447aa184f222b6fce9f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:02.229349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.229891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.229994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.255024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:02.256685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.325598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1036/2075] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:02.380011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:02.382310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.451211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868809ee-5847-4e5a-8b7a-a24af581d37b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:02.458870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:02.459893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.460792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.462010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.476710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:02.478978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:02.492546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1040/2076] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:02 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:02.968297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:02.970366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.983651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2bff2-3dff-4db4-bf57-c2561ffc6977 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:02.992441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:02.993512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.993980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.994422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] PATH_INFO: `/v3/projects/d5fadacda75f4056a87305cf132ac42f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.996104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fadacda75f4056a87305cf132ac42f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:02.998211 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:03.060969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fadacda75f4056a87305cf132ac42f', 'request_id': 'req-d01caefe-7b97-477b-a548-657b9e805a16'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:03.070099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fadacda75f4056a87305cf132ac42f', 'request_id': 'req-d01caefe-7b97-477b-a548-657b9e805a16'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:03.085807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fadacda75f4056a87305cf132ac42f', 'request_id': 'req-d01caefe-7b97-477b-a548-657b9e805a16'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:03.088752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] The token cache is being invalidate because project d5fadacda75f4056a87305cf132ac42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:03.089041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:03.089695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d01caefe-7b97-477b-a548-657b9e805a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:03.091255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1037/2077] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:02 2022] DELETE /identity/v3/projects/d5fadacda75f4056a87305cf132ac42f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:05.258059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:05.259333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:05.276180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663053a2-1386-4303-b421-3b9a088faed1 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:05.367062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:05.368329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:05.368617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:05.368940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] PATH_INFO: `/v3/users/d1de3df741054545a9b740289a33fb10` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:05.378597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1de3df741054545a9b740289a33fb10)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:05.378597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:05.445058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1de3df741054545a9b740289a33fb10'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:05.446338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1de3df741054545a9b740289a33fb10'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:05.447019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1de3df741054545a9b740289a33fb10'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:05.461857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1de3df741054545a9b740289a33fb10'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:05.471170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1de3df741054545a9b740289a33fb10'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:05.487568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1041/2078] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:05 2022] DELETE /identity/v3/users/d1de3df741054545a9b740289a33fb10 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:05.492169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:05.492629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:05.492728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:05.510193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:05.511384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:05.576395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1038/2079] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:05.587365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:05.588746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:05.648300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48e9-705e-49a5-b6a5-39464d999668 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:05.658871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:05.659915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:05.660375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:05.660831 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:05.677339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:05.679780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00d935-9fa0-44bf-b8b6-310d79a54ef7 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:05.696266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1042/2080] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:05 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:06.254423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.257102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:06.281694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d703bc-4198-486a-a66a-bb5fb9a89a71 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.290328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.292798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.293275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.293765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] PATH_INFO: `/v3/projects/d4717e6aac8e452dbc45a32ab322184b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.295790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4717e6aac8e452dbc45a32ab322184b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.299157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.369321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4717e6aac8e452dbc45a32ab322184b', 'request_id': 'req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:06.380608 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4717e6aac8e452dbc45a32ab322184b', 'request_id': 'req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:06.392317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4717e6aac8e452dbc45a32ab322184b', 'request_id': 'req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:06.402945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] The token cache is being invalidate because project d4717e6aac8e452dbc45a32ab322184b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:06.403326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:06.404001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1c1c6317-34b2-4aa6-9e69-4c2afc6e4bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:06.406228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1039/2081] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:06 2022] DELETE /identity/v3/projects/d4717e6aac8e452dbc45a32ab322184b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:06.413647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.414159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.414245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.452750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:06.460788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:06.565124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1043/2082] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:06.573999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.574485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.574565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.614390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:06.616437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:06.641396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1040/2083] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:06.642745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.652468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b201-28db-47e2-ae23-8a860eb5fa45 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.657467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.658184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.658464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.658912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.659647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:06.659956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.661585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.676772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1044/2084] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:06.683018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.695594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd50b-1bfc-4acc-9f09-84a3a321736f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.701084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.701964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.702256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.702535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.703251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.705378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.741266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1041/2085] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:06 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:03:06.745344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.755815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cc57e-bdc5-4e36-89d5-ab30cb0899af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.815264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.815960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.816252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.816538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.817246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.819649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.845327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1045/2086] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:06 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:06.852079 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.871195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016e8f-303c-43cc-adda-de95724169b6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.879565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.880688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.881172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.881666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.883140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.886099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.908080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1042/2087] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:06.912494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.925056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb007d3e-bba2-430a-a402-b60eedaaf1cd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.930179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.930928 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.931637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.932086 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.932917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.934633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605f97-74cd-4d90-9625-9e24c9062104 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:06.953810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1046/2088] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:03:06.957526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:06.968641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f3736-b758-4b0e-88b8-9f27ce232606 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:06.973220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:06.974139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:06.974441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:06.974719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] PATH_INFO: `/v3/projects/63ff0a06d6ef4b0db7a37df1f0652e5a/users/c4704035d34f45249723871aaa4ade35/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:06.990404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ff0a06d6ef4b0db7a37df1f0652e5a, user_id=c4704035d34f45249723871aaa4ade35, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:06.993059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:07.006771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1043/2089] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:06 2022] PUT /identity/v3/projects/63ff0a06d6ef4b0db7a37df1f0652e5a/users/c4704035d34f45249723871aaa4ade35/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:07.017175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:07.017513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:07.017882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:07.047494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] MFA Rules not processed for user `c4704035d34f45249723871aaa4ade35`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:07.048734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:07.109416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1047/2090] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:07 2022] POST /identity/v3/auth/tokens => generated 3419 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:07.120928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:07.122703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:07.180456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ba9e2-4904-4ba1-b0ac-5b593f62b487 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:07.184324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:07.185026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:07.185622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:07.185982 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:07.196293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:07.197967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367548c7-c656-405e-ad56-7f6a754c5eb6 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:07.208080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1044/2091] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:07 2022] GET /identity/v3/auth/tokens => generated 3419 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:21.682296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:21.802499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da74fa-7d8f-477b-8718-00eaaaa60875 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:21.808201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:21.810604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:21.811112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:21.811800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] PATH_INFO: `/v3/users/c4704035d34f45249723871aaa4ade35` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:21.813471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4704035d34f45249723871aaa4ade35)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:21.815915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:21.871642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4704035d34f45249723871aaa4ade35'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:21.872417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4704035d34f45249723871aaa4ade35'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:21.873074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4704035d34f45249723871aaa4ade35'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:21.882863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4704035d34f45249723871aaa4ade35'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:21.890029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4704035d34f45249723871aaa4ade35'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:21.908899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1048/2092] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:21 2022] DELETE /identity/v3/users/c4704035d34f45249723871aaa4ade35 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:21.913461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:21.913976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:21.914085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:21.931805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:21.933009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:21.992680 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1045/2093] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:21 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:22.002589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.004198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:22.064367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb8411-503c-49d0-82d7-56b40024ac20 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.068065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.068714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.069011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.069290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.082065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.083696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790f612-5112-4ec4-91b2-a369d5a55308 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.094894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1049/2094] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:03:22.373494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.375185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:22.391594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880265-19f5-47cb-a492-6d91f044fff1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.396194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.397141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.397336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.397611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] PATH_INFO: `/v3/projects/63ff0a06d6ef4b0db7a37df1f0652e5a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.398862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ff0a06d6ef4b0db7a37df1f0652e5a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.400816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.447418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ff0a06d6ef4b0db7a37df1f0652e5a', 'request_id': 'req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:22.455331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ff0a06d6ef4b0db7a37df1f0652e5a', 'request_id': 'req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:22.461620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ff0a06d6ef4b0db7a37df1f0652e5a', 'request_id': 'req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:22.472022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] The token cache is being invalidate because project 63ff0a06d6ef4b0db7a37df1f0652e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:22.472322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:22.472932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-7dd2fa98-fa0e-4aba-81bf-6f977b5fdcc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:22.474490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1046/2095] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:22 2022] DELETE /identity/v3/projects/63ff0a06d6ef4b0db7a37df1f0652e5a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:22.480261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.480560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.480843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.498328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:22.499547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:22.557551 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1050/2096] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:22.566012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.566303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.566579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.585012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:22.586252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:22.594596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1047/2097] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:22.598541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.608087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c08a-1331-4d89-b6cc-07a6113c61c0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.612658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.613314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.613598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.613908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.614624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:22.614930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.616525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.628389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1051/2098] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:22.632452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.642182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef079-a78d-4e77-a53d-23bd9fc0f377 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.648590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.649345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.649677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.649832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.650530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.652437 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.679738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1048/2099] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:22 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:22.683908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.694382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06094662-0825-4d79-a018-0e3c88bda5f5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.748515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.749186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.749474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.749777 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.750647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.752562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.771462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1052/2100] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:22 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:22.775596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.786475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018055-5546-4ba4-8930-2a65ccac992a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.791221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.791895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.792188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.792467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.793193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.794833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.806323 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1049/2101] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:22.810211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.820525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1b514-7937-4841-8e6d-7df7185aa4e2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.825300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.826148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.826693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.826966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.827693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.829279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2e0c4-c670-40b5-8785-9184e9802f22 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.839611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1053/2102] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:22.844298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.853975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7bae4-be69-4bca-bbb4-1f970d558d32 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:22.859185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:22.860082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.860349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.860618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] PATH_INFO: `/v3/projects/8f948307a28a46c882d15550cc527d3e/users/7abe1b4b11304db7965ce3e6d9c56c42/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.875574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f948307a28a46c882d15550cc527d3e, user_id=7abe1b4b11304db7965ce3e6d9c56c42, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:22.878313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:22.893642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1050/2103] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:22 2022] PUT /identity/v3/projects/8f948307a28a46c882d15550cc527d3e/users/7abe1b4b11304db7965ce3e6d9c56c42/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:22.898456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee6b-2ed6-4313-82c3-ca977c4d189f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:22.898760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee6b-2ed6-4313-82c3-ca977c4d189f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:22.899049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee6b-2ed6-4313-82c3-ca977c4d189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:22.916983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-952aee6b-2ed6-4313-82c3-ca977c4d189f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:22.918238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-952aee6b-2ed6-4313-82c3-ca977c4d189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:22.977944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1054/2104] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:22.987814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:22.989540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:23.044719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531677f-dc16-44b7-88d6-18a7911e7e0f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:23.048537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:23.049190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:23.049472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:23.049769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:23.058904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:23.060331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c1aa-4677-4d65-ab4f-d37cc4dd3528 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:23.070557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1051/2105] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:03:25.871514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:25.875417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:25.876296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:25.941633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] MFA Rules not processed for user `9717e2ab2be74631aba4b196112bf984`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:25.943475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:26.040124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1055/2106] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:25 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:28.148578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.149060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.149174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.191946 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] MFA Rules not processed for user `7abe1b4b11304db7965ce3e6d9c56c42`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:28.193263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:28.269515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1052/2107] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:28 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:28.273788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.289574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde7563-8eef-483c-b9b8-7a2670bd5aa9 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.296940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.297903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.298196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.298479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.299184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.301320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.334799 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1056/2108] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:28 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:28.342027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.356172 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1973-2002-4036-b56c-93adef2a5593 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.416709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.417394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.417683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.417998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.418724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.421171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.441659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1053/2109] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:28 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:28.446499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.456958 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bdffd-628b-4635-b642-3dce442e8f3d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.461611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.462303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.462588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.462863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.463580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.465161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.475362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1057/2110] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:28.479469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.490624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a9b6-13f1-4f9b-b2a9-e254fd43028e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.495554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.496459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.496744 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.497025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] PATH_INFO: `/v3/projects/f7958af1ab86410ba70c5300b15da9d8/users/4f52c3b1c6e3457da6957a388e6d7dff/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.512510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7958af1ab86410ba70c5300b15da9d8, user_id=4f52c3b1c6e3457da6957a388e6d7dff, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.515204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.527734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1054/2111] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:28 2022] PUT /identity/v3/projects/f7958af1ab86410ba70c5300b15da9d8/users/4f52c3b1c6e3457da6957a388e6d7dff/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:28.532565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.542464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab765-e0dd-4ab1-b1ab-b8233a57a5d5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.602354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.603028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.603309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.603585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.604299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.606018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb9e97-8382-4532-8fbf-c76336123bb3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.617764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1058/2112] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:28.621941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.631957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c62a-5207-4b0f-9926-43af2823badb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.636501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.637370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.637650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.637988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] PATH_INFO: `/v3/projects/f7958af1ab86410ba70c5300b15da9d8/users/4f52c3b1c6e3457da6957a388e6d7dff/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.640099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7958af1ab86410ba70c5300b15da9d8, user_id=4f52c3b1c6e3457da6957a388e6d7dff, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.642797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.652645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1055/2113] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:28 2022] PUT /identity/v3/projects/f7958af1ab86410ba70c5300b15da9d8/users/4f52c3b1c6e3457da6957a388e6d7dff/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:32.015330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ded80-73a9-4910-b0a5-0c52b6ca925c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:32.017029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ded80-73a9-4910-b0a5-0c52b6ca925c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:32.017719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ded80-73a9-4910-b0a5-0c52b6ca925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:32.050044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-585ded80-73a9-4910-b0a5-0c52b6ca925c None None] MFA Rules not processed for user `1f85e8545e634ff99938a4c9dfa1bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:32.051803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-585ded80-73a9-4910-b0a5-0c52b6ca925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:32.143787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1059/2114] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:32 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:36.208141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:36.210670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:36.297520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f04c1-214f-42bf-b9aa-354ea0751deb admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:36.305088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:36.306509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:36.306509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:36.306694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] PATH_INFO: `/v3/users/a1faf897c3c342a6b42bb58dbc23469a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:36.307908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1faf897c3c342a6b42bb58dbc23469a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:36.309861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:36.401540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1faf897c3c342a6b42bb58dbc23469a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:36.402509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1faf897c3c342a6b42bb58dbc23469a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:36.403350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1faf897c3c342a6b42bb58dbc23469a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:36.418353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1faf897c3c342a6b42bb58dbc23469a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:36.428996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1faf897c3c342a6b42bb58dbc23469a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:36.453785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1056/2115] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:36 2022] DELETE /identity/v3/users/a1faf897c3c342a6b42bb58dbc23469a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:36.458125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:36.458935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:36.459370 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:36.478221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:36.479443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:36.593726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1060/2116] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:36.606433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:36.609014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:36.706349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18750aa-9f4d-49b5-a11c-f30c6c88bfab admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:36.714218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:36.715485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:36.715929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:36.716361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:36.743735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:36.746292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1404e1-4f57-49f3-8004-0a10d45b6c00 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:36.767406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1057/2117] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:37.267668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.272451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:37.294902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c2e8c-07e1-45f5-b0ea-854fa57ff45a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.308560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.309457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.309738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.310055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] PATH_INFO: `/v3/projects/a347ae61ad124e1e9038751eaa4413ba` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.318769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a347ae61ad124e1e9038751eaa4413ba)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.320718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.396366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a347ae61ad124e1e9038751eaa4413ba', 'request_id': 'req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:37.413445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a347ae61ad124e1e9038751eaa4413ba', 'request_id': 'req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:37.419941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a347ae61ad124e1e9038751eaa4413ba', 'request_id': 'req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:37.449795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] The token cache is being invalidate because project a347ae61ad124e1e9038751eaa4413ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:37.453873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:37.455289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-292c37ff-89a5-4122-9dc7-4eb3b74e6e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:37.457535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1061/2118] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:37 2022] DELETE /identity/v3/projects/a347ae61ad124e1e9038751eaa4413ba => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:37.462906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.463725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.464259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.489055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:37.490366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:37.603648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1058/2119] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:37.614353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.614850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.615125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.637226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:37.639052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:37.655074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1062/2120] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:37.659689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.670986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60f68-0362-446e-81f2-68a145e7ae4e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.678752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.679775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.680062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.680335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.684660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:37.684990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.689203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.712765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1059/2121] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:37.717769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.727939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bdd8-4f35-4a4a-a534-3f3c15bc5d73 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.733174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.734211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.734717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.735172 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.736029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.737963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.767380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1063/2122] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:37 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:37.771567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.782031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08f9c-64d9-420a-914c-a7ef8be87dc4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.852525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.853205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.853485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.853802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.854486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.856386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.877484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1060/2123] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:37 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:37.881515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.892044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea73eaf-aff4-4de2-9adc-3c9b6d751834 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.896587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.897254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.897534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.897833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.898552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.900145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.912023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1064/2124] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:37.915924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.927627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fcea2-3b44-4b78-81ce-51fb362a8df4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.934758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.936813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.936813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.937119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.938512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.940273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26207b32-0ef5-4d0b-a542-ceaa03b30aba admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.954114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1061/2125] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:37.958178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.968198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48420-4207-4ab3-b828-26b135af63db admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.972849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.973722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.974071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.974354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] PATH_INFO: `/v3/projects/031aabfc41fb4aca9ca7fbc468dbbd74/users/cf8b9f8da902497881dd112d0ad3f4a1/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.989582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031aabfc41fb4aca9ca7fbc468dbbd74, user_id=cf8b9f8da902497881dd112d0ad3f4a1, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.992270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:38.006910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1065/2126] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:37 2022] PUT /identity/v3/projects/031aabfc41fb4aca9ca7fbc468dbbd74/users/cf8b9f8da902497881dd112d0ad3f4a1/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:38.020174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ef1c-62a5-428f-bae8-4d87cd24fb47 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:38.020795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ef1c-62a5-428f-bae8-4d87cd24fb47 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:38.021222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024ef1c-62a5-428f-bae8-4d87cd24fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:38.052112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8024ef1c-62a5-428f-bae8-4d87cd24fb47 None None] MFA Rules not processed for user `cf8b9f8da902497881dd112d0ad3f4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:38.053694 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8024ef1c-62a5-428f-bae8-4d87cd24fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.138289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1062/2127] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:38 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:38.144587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:38.146520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.213153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475fbb7-e688-4d5d-9331-efff89d64967 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:38.217384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:38.218669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:38.218931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:38.219401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:38.229658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:38.231155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:38.245942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1066/2128] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:03:38.353517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745d54-05ac-4fb1-989a-45ab0254640b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:38.353836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745d54-05ac-4fb1-989a-45ab0254640b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:38.354122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745d54-05ac-4fb1-989a-45ab0254640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:38.397446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-97745d54-05ac-4fb1-989a-45ab0254640b None None] MFA Rules not processed for user `4f52c3b1c6e3457da6957a388e6d7dff`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:38.398733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-97745d54-05ac-4fb1-989a-45ab0254640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.542880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1063/2129] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:38 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:38.556378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:38.557940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.720351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bff74-80e8-41b4-813e-457902306357 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:38.726433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:38.727668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:38.728141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:38.728421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:38.730744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.855702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:38.858819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:38.887161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1067/2130] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:03:39.128312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:39.129328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:39.129866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:39.158156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:39.159655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:39.243577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1064/2131] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:39.316107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:39.318513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:39.406951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053716e-c263-48c6-9684-f5ad526f3cca service glance] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:39.413535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:39.415114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:39.415114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:39.415114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:39.426606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:39.428251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9cbf-db3e-4439-89ad-1d0c15580d26 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:39.442010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1068/2132] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:43.242705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:43.245022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:43.447358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53b45-a5d9-45a4-aa61-5a26200c53ff None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:43.455126 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:43.457284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:43.458976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:43.459545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] PATH_INFO: `/v3/users/cd900584837a4618842d32de567395f5` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:43.462902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd900584837a4618842d32de567395f5)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:43.465722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:43.581490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd900584837a4618842d32de567395f5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:43.583511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd900584837a4618842d32de567395f5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:43.584383 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd900584837a4618842d32de567395f5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:43.596032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd900584837a4618842d32de567395f5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:43.604986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd900584837a4618842d32de567395f5'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:43.629384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1065/2133] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:43 2022] DELETE /identity/v3/users/cd900584837a4618842d32de567395f5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:43.634141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:43.634827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:43.634827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:43.654973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:43.656525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:43.743916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1069/2134] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:43.752093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:43.753027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:43.845223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f693-45b6-4fae-9b10-f7f63cb8a3c0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:43.854211 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:43.855053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:43.855346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:43.857902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:43.879670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:43.881490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:43.896262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1066/2135] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:44.401966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:44.403573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:44.433253 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4968-c257-4f25-8c10-6e6fe6bf8b06 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:44.441544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:44.442761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:44.443217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:44.443647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] PATH_INFO: `/v3/projects/3666055374f5485d9e9c9f9177c3dccc` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:44.445218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3666055374f5485d9e9c9f9177c3dccc)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:44.450369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:44.558967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3666055374f5485d9e9c9f9177c3dccc', 'request_id': 'req-e7954a36-dd18-4b1c-ac59-ca40421c360d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.570012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3666055374f5485d9e9c9f9177c3dccc', 'request_id': 'req-e7954a36-dd18-4b1c-ac59-ca40421c360d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.586063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3666055374f5485d9e9c9f9177c3dccc', 'request_id': 'req-e7954a36-dd18-4b1c-ac59-ca40421c360d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.598359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] The token cache is being invalidate because project 3666055374f5485d9e9c9f9177c3dccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:44.598927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.599775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.606050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:44.606677 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1070/2136] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:44 2022] DELETE /identity/v3/projects/3666055374f5485d9e9c9f9177c3dccc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:44.619290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114eec6-5047-4347-a3d9-4d2db29dde59 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:44.741251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:44.742212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:44.742491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:44.742762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] PATH_INFO: `/v3/users/374496db7e92494093fed34bb9511d92` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:44.744073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=374496db7e92494093fed34bb9511d92)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:44.747231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:44.903111 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374496db7e92494093fed34bb9511d92'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.903867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374496db7e92494093fed34bb9511d92'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.905255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374496db7e92494093fed34bb9511d92'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.914923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374496db7e92494093fed34bb9511d92'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.927184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6666e3c0-f17c-46d0-ac56-44edcf6008e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374496db7e92494093fed34bb9511d92'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:44.950784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1067/2137] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:44 2022] DELETE /identity/v3/users/374496db7e92494093fed34bb9511d92 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:45.356437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:45.358540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:45.378254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7954a36-dd18-4b1c-ac59-ca40421c360d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:45.481807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:45.483717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.483996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.484451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] PATH_INFO: `/v3/projects/8006f3f6db6342baac9aaca4ec58ad81` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.485878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8006f3f6db6342baac9aaca4ec58ad81)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:45.488058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:45.574858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8006f3f6db6342baac9aaca4ec58ad81', 'request_id': 'req-509f572b-8ec4-40ed-8b0b-293bd62ec14a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:45.586324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8006f3f6db6342baac9aaca4ec58ad81', 'request_id': 'req-509f572b-8ec4-40ed-8b0b-293bd62ec14a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:45.592931 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8006f3f6db6342baac9aaca4ec58ad81', 'request_id': 'req-509f572b-8ec4-40ed-8b0b-293bd62ec14a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:45.605095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] The token cache is being invalidate because project 8006f3f6db6342baac9aaca4ec58ad81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:45.605431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:45.606113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-509f572b-8ec4-40ed-8b0b-293bd62ec14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:45.608157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1071/2138] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:45 2022] DELETE /identity/v3/projects/8006f3f6db6342baac9aaca4ec58ad81 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:45.615587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.616122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.616122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.636551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:45.638067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:45.714173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1068/2139] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:45.716783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.717590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.718162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.739304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:45.740546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:45.752592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1072/2140] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:45.756564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:45.768158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa0a02-ed5d-40bf-ac35-00acdce78e31 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:45.773344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:45.774057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.774343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.774616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.775341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:45.775649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:45.777284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:45.798149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1069/2141] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:03:45.802293 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:45.815300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d370-f152-4ca5-a61c-806705660699 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:45.823006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:45.823976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.824431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.824708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.825586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:45.827580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:45.913493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1073/2142] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:45 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:45.917835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:45.930228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27aeef-64f6-4749-899b-1a8f23b5be43 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.081494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.082208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.082501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.083191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.084143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.086609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:46.134216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1070/2143] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:45 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:46.135707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.208545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0644d-217f-431c-92d9-d113bef2a7b3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.215177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.215967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.216318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.216663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.219855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.221498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:46.266278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1074/2144] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:46.273960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.285892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd18-1756-4490-9c0f-ef3e25633af6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.291761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.296712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.297039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.297280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.298473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.301329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63be116-5fd4-411a-9a04-bee81b1b3f1b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:46.327339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.336387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1071/2145] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:46.342974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fc337-eaf1-4cd2-8335-feb817225e24 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.347917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.348995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.349282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.349570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] PATH_INFO: `/v3/projects/a777b100302a4d368012ad29fced2b2a/users/69b3430e67f1451abc9b9244c1dd3d46/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.372609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a777b100302a4d368012ad29fced2b2a, user_id=69b3430e67f1451abc9b9244c1dd3d46, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.376522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:46.411786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1075/2146] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:46 2022] PUT /identity/v3/projects/a777b100302a4d368012ad29fced2b2a/users/69b3430e67f1451abc9b9244c1dd3d46/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:46.423088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.423395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.423658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.472341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] MFA Rules not processed for user `69b3430e67f1451abc9b9244c1dd3d46`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:46.473877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:46.582978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1072/2147] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:46.589690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.742342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acfd99-ce65-4936-b977-7aaa36523c6c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.760314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.761167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.761556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.761963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.762839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.765693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:46.841947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1076/2148] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:46 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:46.843135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.862407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffbc3-754a-4423-9cfe-61ba1b702c15 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.962456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.962954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.963240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.963677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.964223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.966292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.062183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1073/2149] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:46 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:47.068113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.087725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5afcd8-4846-44e9-8446-d1768bbdefd7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.112151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.112481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.112682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.112966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.113927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.116159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.159353 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1077/2150] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:47.160538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.194410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204330e-3abe-4024-bd5c-c496fab0c846 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.201138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.202635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.202924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.203206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] PATH_INFO: `/v3/projects/d4ae3488bdf24ed889357562772d3646/users/793fb6a9406141c2a5790eec08180431/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.228361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ae3488bdf24ed889357562772d3646, user_id=793fb6a9406141c2a5790eec08180431, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.242206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.283610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1074/2151] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:47 2022] PUT /identity/v3/projects/d4ae3488bdf24ed889357562772d3646/users/793fb6a9406141c2a5790eec08180431/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:47.287421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.301696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd989-5e42-4093-b2d5-fda153406ba6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.402837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.403563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.404048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.404870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.405736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.407742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8eaad-354a-41e4-9581-3bd7d6f9e1d6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.421828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1078/2152] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:03:47.426712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.448278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9774f-17c0-4531-872f-a0b7bc7e7405 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.460455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.461648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.461972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.462245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] PATH_INFO: `/v3/projects/d4ae3488bdf24ed889357562772d3646/users/793fb6a9406141c2a5790eec08180431/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.464464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ae3488bdf24ed889357562772d3646, user_id=793fb6a9406141c2a5790eec08180431, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.468093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.489269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1075/2153] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:47 2022] PUT /identity/v3/projects/d4ae3488bdf24ed889357562772d3646/users/793fb6a9406141c2a5790eec08180431/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:47.500632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.500929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.501208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.534279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] MFA Rules not processed for user `793fb6a9406141c2a5790eec08180431`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:47.535795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:47.656540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1079/2154] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:47 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:47.663673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.665585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:47.784110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cb88-cd88-4f12-b418-48711de5f9c7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.787756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.788519 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.788874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.789215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.805652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.807155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c991fc2-dcb2-47d6-98ab-08cfa79f7f0d service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.819381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1076/2155] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:47 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:03:47.889214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:47.974325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17c14-0b46-4bea-99bd-f6a930549840 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:47.979776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:47.980927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:47.981360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:47.981699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] PATH_INFO: `/v3/users/69b3430e67f1451abc9b9244c1dd3d46` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:47.983187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b3430e67f1451abc9b9244c1dd3d46)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:47.985274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:48.050872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b3430e67f1451abc9b9244c1dd3d46'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:48.051614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b3430e67f1451abc9b9244c1dd3d46'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:48.052371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b3430e67f1451abc9b9244c1dd3d46'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:48.068729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b3430e67f1451abc9b9244c1dd3d46'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:48.083953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b3430e67f1451abc9b9244c1dd3d46'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:48.112411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1080/2156] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:47 2022] DELETE /identity/v3/users/69b3430e67f1451abc9b9244c1dd3d46 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:48.115914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.116470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.116470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.147200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:48.148557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:48.224534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1077/2157] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:48.235738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:48.237377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:48.393023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da321b2-81f9-47d7-9d94-405d1c652cdc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:48.408154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:48.409460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.410487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.411089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.441893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:48.443873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:48.456281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1081/2158] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:48.924598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:48.926546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:48.956949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c9ef2-2c01-4a02-b71e-7c4327f35860 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:48.962248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:48.963262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.963500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.963749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] PATH_INFO: `/v3/projects/a777b100302a4d368012ad29fced2b2a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.965538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a777b100302a4d368012ad29fced2b2a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:48.968119 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:49.032569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a777b100302a4d368012ad29fced2b2a', 'request_id': 'req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.040715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a777b100302a4d368012ad29fced2b2a', 'request_id': 'req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.049967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a777b100302a4d368012ad29fced2b2a', 'request_id': 'req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.062986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] The token cache is being invalidate because project a777b100302a4d368012ad29fced2b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:49.062986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.064377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.066403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1078/2159] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:48 2022] DELETE /identity/v3/projects/a777b100302a4d368012ad29fced2b2a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:49.069815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:49.080934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97725-ab7c-4da5-ab83-cf6708ea6c55 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:49.151180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:49.152098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:49.152439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:49.152724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] PATH_INFO: `/v3/users/793fb6a9406141c2a5790eec08180431` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:49.154611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] RBAC: Authorizing `identity:delete_user(user_id=793fb6a9406141c2a5790eec08180431)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:49.157637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:49.227731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793fb6a9406141c2a5790eec08180431'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.229289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793fb6a9406141c2a5790eec08180431'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.230149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793fb6a9406141c2a5790eec08180431'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.241943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793fb6a9406141c2a5790eec08180431'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.260793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5e9ba6d2-b35c-402d-8254-ea1fe391839a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793fb6a9406141c2a5790eec08180431'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.291454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1082/2160] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:49 2022] DELETE /identity/v3/users/793fb6a9406141c2a5790eec08180431 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:49.674508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:49.677470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:49.725028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0824d-f5d6-40e8-96b7-19f9ec6e0164 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:49.814542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:49.816618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:49.817362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:49.818100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] PATH_INFO: `/v3/projects/d4ae3488bdf24ed889357562772d3646` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:49.820533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ae3488bdf24ed889357562772d3646)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:49.825822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:49.952801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ae3488bdf24ed889357562772d3646', 'request_id': 'req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.971782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ae3488bdf24ed889357562772d3646', 'request_id': 'req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:49.982102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ae3488bdf24ed889357562772d3646', 'request_id': 'req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:50.001155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] The token cache is being invalidate because project d4ae3488bdf24ed889357562772d3646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:50.001454 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:50.002627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-87cccc5f-db83-4c84-8c8a-3dfb5d1a860b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:50.008665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1079/2161] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:49 2022] DELETE /identity/v3/projects/d4ae3488bdf24ed889357562772d3646 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:50.015381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.015920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.016004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.073813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:50.075723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:50.163896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1083/2162] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:50.171835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.172162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.174180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.198134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:50.199426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:50.208797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1080/2163] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:50.212768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.225539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f68b7-c232-4922-9b8d-bde6649163f2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.236166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.237503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.238279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.238990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.239944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:50.240552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.242518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.258885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1084/2164] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:50.262830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.280640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a308f-0f6d-4f74-a607-3406074f3cd2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.293802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.294915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.295431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.295984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.296919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.299149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.335895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1081/2165] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:03:50.341335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.367660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679a9a9-80be-4510-867f-a43ffba59296 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.476629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.476891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.477122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.477364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.478295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.480561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.511073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1085/2166] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:50.517848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.541798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833372ca-121d-4edf-b982-67eea4748042 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.561585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.562410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.562937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.563053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.564198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.565939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.586034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1082/2167] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:50.589238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.603119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e5b5-626a-4948-843f-2b99ea092425 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.611927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.612536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.612710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.612958 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.613663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.615570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40102-62c5-4a98-91ec-2fa40191992c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.640477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1086/2168] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:50.645412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.655791 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652c07-be4c-4023-a84d-b3dd328aa39f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.662284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.663397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.663676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.664228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] PATH_INFO: `/v3/projects/2566d3e7902e442fa822ffad2277668a/users/ce12f1b48c684ec18a5023beb1d717b7/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.680994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2566d3e7902e442fa822ffad2277668a, user_id=ce12f1b48c684ec18a5023beb1d717b7, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:50.684410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:50.709993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1083/2169] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:50 2022] PUT /identity/v3/projects/2566d3e7902e442fa822ffad2277668a/users/ce12f1b48c684ec18a5023beb1d717b7/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:50.714348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:50.714642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:50.714926 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:50.750210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] MFA Rules not processed for user `ce12f1b48c684ec18a5023beb1d717b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:50.751823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:50.869882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1087/2170] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:50.875921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:50.990749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a38bd9-3848-4519-b318-012bd0781631 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:50.998072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:50.998920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.006307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.006681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.007586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.009661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.061613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1084/2171] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:51.062844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.075873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0d59-32a2-4334-9a86-6b666475ce50 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.169724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.170944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.171386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.171970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.172846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.175115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.216273 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1088/2172] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:51 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:51.217432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.232599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222a0c-db39-4b75-b8c7-6e154691aabc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.241575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.242368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.242696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.242926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.243811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.245866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.258376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1085/2173] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:03:51.263309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.279219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d42b-e258-45a6-88a2-d1e774c158bd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.293226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.294183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.294484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.294800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] PATH_INFO: `/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b/users/af1ebe3b2e3d4dd5938083f95dd77bcc/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.314740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce844fe1e32441a8c430a7fd66f9e9b, user_id=af1ebe3b2e3d4dd5938083f95dd77bcc, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.317684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.351979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1089/2174] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:51 2022] PUT /identity/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b/users/af1ebe3b2e3d4dd5938083f95dd77bcc/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:51.355884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.377840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98935-9e6b-49d4-999b-b3eb50b782f3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.482277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.483570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.483908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.484267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.485203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.487014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72287c51-633d-43bb-b238-9cc2fbf4d19b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.501178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1086/2175] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:51.506265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.524797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4622-f05b-41a4-b34c-1af9c3c53b35 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.530870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.531775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.532057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.532333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] PATH_INFO: `/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b/users/af1ebe3b2e3d4dd5938083f95dd77bcc/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.536317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce844fe1e32441a8c430a7fd66f9e9b, user_id=af1ebe3b2e3d4dd5938083f95dd77bcc, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.539603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:51.553717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1090/2176] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:51 2022] PUT /identity/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b/users/af1ebe3b2e3d4dd5938083f95dd77bcc/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:51.565349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.566022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.566508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.616602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] MFA Rules not processed for user `af1ebe3b2e3d4dd5938083f95dd77bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:51.618316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:51.738790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1087/2177] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:51 2022] POST /identity/v3/auth/tokens => generated 3468 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:51.750527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:51.752603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:51.971294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390061f9-9f1f-4ade-84d8-09fad1db9fc8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:51.981720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:51.982486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:51.982759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:51.983057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:51.994388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:51.995901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:52.015950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1091/2178] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:51 2022] GET /identity/v3/auth/tokens => generated 3468 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:52.638425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:52.648363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb93571-aedd-4261-aaea-0ec954dc5c3d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:52.665565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af1ebe3b2e3d4dd5938083f95dd77bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ce844fe1e32441a8c430a7fd66f9e9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:52.666204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:52.666562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:52.666855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:52.667636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:52.667961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:52.669668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:52.700528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1088/2179] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:52.701121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:52.712396 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df98f1-d9a1-48e8-a68d-bb5ee4bd3407 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:52.722540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af1ebe3b2e3d4dd5938083f95dd77bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ce844fe1e32441a8c430a7fd66f9e9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:52.723220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:52.723516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:52.723787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:52.724720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:52.726745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:52.775495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1092/2180] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:52 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:03:52.779773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:52.791724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a882-2c37-48de-ad91-e90885c079fc tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:52.958647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af1ebe3b2e3d4dd5938083f95dd77bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ce844fe1e32441a8c430a7fd66f9e9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:52.959557 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:52.962223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:52.964225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:52.965178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:52.967372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:52.985554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:53.037107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1089/2181] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:03:53.098122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:53.118553 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc41b0-72f5-4580-a402-d02eb1fe7b24 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:53.126445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af1ebe3b2e3d4dd5938083f95dd77bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ce844fe1e32441a8c430a7fd66f9e9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:53.127727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:53.128188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:53.130807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] PATH_INFO: `/v3/projects/6c33831b9bbb453a8687a14e907eec50` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:53.130807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c33831b9bbb453a8687a14e907eec50)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:53.137294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:53.261771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c33831b9bbb453a8687a14e907eec50', 'request_id': 'req-53c7a3a3-3574-4df2-a4c7-8ea36439329a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:53.287839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c33831b9bbb453a8687a14e907eec50', 'request_id': 'req-53c7a3a3-3574-4df2-a4c7-8ea36439329a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:53.312008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c33831b9bbb453a8687a14e907eec50', 'request_id': 'req-53c7a3a3-3574-4df2-a4c7-8ea36439329a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:53.358193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] The token cache is being invalidate because project 6c33831b9bbb453a8687a14e907eec50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:53.361910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:53.364090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-53c7a3a3-3574-4df2-a4c7-8ea36439329a tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:53.374962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1093/2182] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:53 2022] DELETE /identity/v3/projects/6c33831b9bbb453a8687a14e907eec50 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:53.757813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:53.760604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:53.878344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6489b-d6cd-41c6-b45a-78eca7e1e634 tempest-VolumeQuotaClassesTest-1301621356 tempest-VolumeQuotaClassesTest-1301621356-project-admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:53.983142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:53.985371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:53.985926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:53.987034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] PATH_INFO: `/v3/users/ce12f1b48c684ec18a5023beb1d717b7` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:53.989300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce12f1b48c684ec18a5023beb1d717b7)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:53.993117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:54.095693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce12f1b48c684ec18a5023beb1d717b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:54.096769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce12f1b48c684ec18a5023beb1d717b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:54.097480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce12f1b48c684ec18a5023beb1d717b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:54.107492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce12f1b48c684ec18a5023beb1d717b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:54.116857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce12f1b48c684ec18a5023beb1d717b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:54.136895 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1090/2183] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:53 2022] DELETE /identity/v3/users/ce12f1b48c684ec18a5023beb1d717b7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:54.142334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417fdf-f5bd-4d04-a8e7-180fa56e5432 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.142974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417fdf-f5bd-4d04-a8e7-180fa56e5432 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.143448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417fdf-f5bd-4d04-a8e7-180fa56e5432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.190759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-94417fdf-f5bd-4d04-a8e7-180fa56e5432 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:54.193916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-94417fdf-f5bd-4d04-a8e7-180fa56e5432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:54.318891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1094/2184] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:54.329697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:54.330604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30eb9e-1313-407b-bf27-b12cabbac3a9 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.330898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30eb9e-1313-407b-bf27-b12cabbac3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.331162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:54.331398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30eb9e-1313-407b-bf27-b12cabbac3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.349174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3e30eb9e-1313-407b-bf27-b12cabbac3a9 None None] MFA Rules not processed for user `7abe1b4b11304db7965ce3e6d9c56c42`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:54.350431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3e30eb9e-1313-407b-bf27-b12cabbac3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:54.407968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1095/2185] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:54.422061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6a2c-468f-43b4-88dc-5244c6d4f877 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:54.427689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:54.428684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.429129 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.429575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.445490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:54.447992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:54.463572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1091/2186] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:54.783447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.783730 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.784006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.836890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:54.840953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:54.919069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:54.922341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:54.955301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51407157-8c71-4887-b531-ded31d900098 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:54.964720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:54.965950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.966526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.966996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] PATH_INFO: `/v3/projects/2566d3e7902e442fa822ffad2277668a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.969025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2566d3e7902e442fa822ffad2277668a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:54.973058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:55.020445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1096/2187] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:54 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:55.046276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:55.048440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:55.118153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2566d3e7902e442fa822ffad2277668a', 'request_id': 'req-e4285806-f4a9-45dc-8d07-8f083591f487'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.135756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2566d3e7902e442fa822ffad2277668a', 'request_id': 'req-e4285806-f4a9-45dc-8d07-8f083591f487'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.150960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2566d3e7902e442fa822ffad2277668a', 'request_id': 'req-e4285806-f4a9-45dc-8d07-8f083591f487'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.152927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b149c3-f3e3-413b-97f2-8bbc3ab8ff1d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:55.172570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] The token cache is being invalidate because project 2566d3e7902e442fa822ffad2277668a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:55.173025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.174231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.177035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1092/2188] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:54 2022] DELETE /identity/v3/projects/2566d3e7902e442fa822ffad2277668a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:55.182629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:55.187023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:55.272260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:55.273131 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:55.274243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:55.275402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:55.280199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:55.320606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4285806-f4a9-45dc-8d07-8f083591f487 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:55.334222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:55.335007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:55.335149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:55.335412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] PATH_INFO: `/v3/users/af1ebe3b2e3d4dd5938083f95dd77bcc` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:55.336761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1ebe3b2e3d4dd5938083f95dd77bcc)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:55.338881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:55.375373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:55.376907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:55.388170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1097/2189] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:55.398278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1ebe3b2e3d4dd5938083f95dd77bcc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.399706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1ebe3b2e3d4dd5938083f95dd77bcc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.400527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1ebe3b2e3d4dd5938083f95dd77bcc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.411472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1ebe3b2e3d4dd5938083f95dd77bcc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.418894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a8ba3ec3-dc57-4c09-bac0-69449291b304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1ebe3b2e3d4dd5938083f95dd77bcc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:55.441058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1093/2190] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:55 2022] DELETE /identity/v3/users/af1ebe3b2e3d4dd5938083f95dd77bcc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:56.086710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:56.102973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec340d-3761-411c-9330-9db57ac59719 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:56.208752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:56.210057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:56.210596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:56.211307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] PATH_INFO: `/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:56.213326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce844fe1e32441a8c430a7fd66f9e9b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:56.215913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:56.324740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce844fe1e32441a8c430a7fd66f9e9b', 'request_id': 'req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:56.467855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce844fe1e32441a8c430a7fd66f9e9b', 'request_id': 'req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:56.495466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce844fe1e32441a8c430a7fd66f9e9b', 'request_id': 'req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:56.557222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] The token cache is being invalidate because project 1ce844fe1e32441a8c430a7fd66f9e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:56.557681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:56.571897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-73b4810a-09b6-48f4-8dc5-53a80ae2fb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:56.577185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1098/2191] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:56 2022] DELETE /identity/v3/projects/1ce844fe1e32441a8c430a7fd66f9e9b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:56.583288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:56.583850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:56.583964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:56.648456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:56.655816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:56.829486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1094/2192] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:56.833151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:56.833666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:56.834200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:56.877854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:56.879067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:56.909977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1099/2193] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:56.911284 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:56.930046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd68b-0e30-4402-a03c-8e164bdc09dd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:56.945871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:56.946625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:56.946840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:56.952758 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:56.953966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:56.954298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:56.962354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.017817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1095/2194] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:57.018644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.037829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3e357-6826-41a8-af46-330d35267ce3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.066750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.067824 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.068411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.072914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.077178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.086405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.142000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1100/2195] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:03:57.146554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.169778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adf72b-7b71-4633-84a5-abcd2d993999 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.382125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.383278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.383805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.384226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.388632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.390521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.425811 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1096/2196] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:57 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:57.430845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.446547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4880d-1fed-4805-8b0f-97d935ba9def admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.461984 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.472491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.472794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.473085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.476904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.480780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.496758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1101/2197] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:57.504485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.517268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d186c0-b07e-4a62-a553-32f00d228856 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.522009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.522688 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.522970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.523249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.523973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.525699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d14f8d-bdc1-487a-9778-91ab47e0ee8f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.536981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1097/2198] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:03:57.541418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.553486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9f1c-1812-4460-af67-e3bf15692b99 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.558420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.559428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.559825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.560202 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] PATH_INFO: `/v3/projects/c0e0a415b6184dd0afe91158f4ae550b/users/37ce497f28b24bb5b7892c1f9d41afe6/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.580755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e0a415b6184dd0afe91158f4ae550b, user_id=37ce497f28b24bb5b7892c1f9d41afe6, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.583591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:57.603282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1102/2199] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:57 2022] PUT /identity/v3/projects/c0e0a415b6184dd0afe91158f4ae550b/users/37ce497f28b24bb5b7892c1f9d41afe6/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:57.623297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.623297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.623297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.672687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] MFA Rules not processed for user `37ce497f28b24bb5b7892c1f9d41afe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:57.675044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:57.836340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1098/2200] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:57 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:57.838149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:57.951858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3c802-dd33-40a6-b788-d12bd63ae03b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:57.958708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:57.959538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:57.959929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:57.960314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:57.961198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:57.965883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.019856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1103/2201] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:57 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:58.020684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.037650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b465d-7144-4ab3-9ecb-d35238f4877c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:58.209360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:58.210231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.210505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.210786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.211868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:58.214188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.281376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.282544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1099/2202] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:58 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:58.299672 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281be03-4395-48c8-a8e2-8596ccdbe7fd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:58.310441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:58.311142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.311430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.311707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.313038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:58.314952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.341211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1104/2203] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:58.342473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.354355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b42101-2ed1-4cf2-8ff7-cb7cadeae37d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:58.361567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:58.362983 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.363439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.364245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] PATH_INFO: `/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a/users/0cc0c2a4bbb0408da77a571f29896477/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.416243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f0c1ee26c54ed2b48e19ffd8e1ce5a, user_id=0cc0c2a4bbb0408da77a571f29896477, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:58.421879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.456886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1100/2204] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:58 2022] PUT /identity/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a/users/0cc0c2a4bbb0408da77a571f29896477/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:58.458199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.468498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71edd45-a401-4bd4-959c-cc7af5d32e62 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:58.602800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:58.603815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.604240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.604654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.605848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:58.609313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48be0c-0e44-4955-8110-097834b65a7d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.640772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1105/2205] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:58.644710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.666824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020139d-31bf-4127-995f-1daec66eab59 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:58.674558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:58.675467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.675757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.676025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] PATH_INFO: `/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a/users/0cc0c2a4bbb0408da77a571f29896477/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.685069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f0c1ee26c54ed2b48e19ffd8e1ce5a, user_id=0cc0c2a4bbb0408da77a571f29896477, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:58.687376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:58.726977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1101/2206] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:58 2022] PUT /identity/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a/users/0cc0c2a4bbb0408da77a571f29896477/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:58.729083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:58.729377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:58.729660 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:58.783828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] MFA Rules not processed for user `0cc0c2a4bbb0408da77a571f29896477`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:58.785382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:58.916167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1106/2207] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:03:58 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:58.945661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:58.949495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:59.287708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c25c3f-f70c-49b2-9d9f-25e415fdbbb2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:59.292221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:59.293112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:59.293598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:59.294100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:59.306741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:59.308709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:59.327843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1102/2208] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:58 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:59.537489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:59.539878 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:59.564729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2ca6-1e29-4cb2-ae53-6cfe055c5edb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:59.583226 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:59.584154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:59.584702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:59.585042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:59.706898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:59.708377 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fc0b4-087e-44f2-96e7-d5eb468c7d6e service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:59.732007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1107/2209] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:59 2022] GET /identity/v3/auth/tokens => generated 3401 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:02.874088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:03.023718 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ffc0-eb51-4992-b134-0ef3027bc368 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:03.035330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:03.036585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:03.037142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:03.037701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] PATH_INFO: `/v3/users/37ce497f28b24bb5b7892c1f9d41afe6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:03.039605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ce497f28b24bb5b7892c1f9d41afe6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:03.042483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:03.163137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ce497f28b24bb5b7892c1f9d41afe6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:03.163841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ce497f28b24bb5b7892c1f9d41afe6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:03.165012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ce497f28b24bb5b7892c1f9d41afe6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:03.182684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ce497f28b24bb5b7892c1f9d41afe6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:03.191951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ce497f28b24bb5b7892c1f9d41afe6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:03.235823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1103/2210] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:02 2022] DELETE /identity/v3/users/37ce497f28b24bb5b7892c1f9d41afe6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:03.241232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:03.242193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:03.242193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:03.271090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:03.273044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:03.381803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1108/2211] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:03.416845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:03.418999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:03.535216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acde2d6-dff9-4ec2-a642-ebc3488bca07 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:03.549822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:03.550621 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:03.550914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:03.551195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:03.568931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:03.570405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:03.591044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1104/2212] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:04.027500 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:04.029815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:04.051581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bfb92-ecc8-4721-b79d-aaf23ed6c19d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:04.069231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:04.070219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:04.070560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:04.071119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] PATH_INFO: `/v3/projects/c0e0a415b6184dd0afe91158f4ae550b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:04.073392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e0a415b6184dd0afe91158f4ae550b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:04.075393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:04.144345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e0a415b6184dd0afe91158f4ae550b', 'request_id': 'req-c27d93d2-ee08-4769-98cc-9640dac16dee'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.155176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e0a415b6184dd0afe91158f4ae550b', 'request_id': 'req-c27d93d2-ee08-4769-98cc-9640dac16dee'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.162356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e0a415b6184dd0afe91158f4ae550b', 'request_id': 'req-c27d93d2-ee08-4769-98cc-9640dac16dee'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.177332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] The token cache is being invalidate because project c0e0a415b6184dd0afe91158f4ae550b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:04.177696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.178318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.180003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1109/2213] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:04 2022] DELETE /identity/v3/projects/c0e0a415b6184dd0afe91158f4ae550b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:04.184025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:04.196427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d834-f718-4988-850e-8f7f8bd8576e service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:04.304728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:04.306995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:04.307588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:04.308329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] PATH_INFO: `/v3/users/0cc0c2a4bbb0408da77a571f29896477` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:04.310421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc0c2a4bbb0408da77a571f29896477)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:04.315670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:04.413700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc0c2a4bbb0408da77a571f29896477'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.414810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc0c2a4bbb0408da77a571f29896477'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.415535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc0c2a4bbb0408da77a571f29896477'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.428469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc0c2a4bbb0408da77a571f29896477'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.438047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c8c99f9e-0836-4c60-89a8-1b0bc9e42640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc0c2a4bbb0408da77a571f29896477'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:04.460834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1105/2214] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:04 2022] DELETE /identity/v3/users/0cc0c2a4bbb0408da77a571f29896477 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:05.030346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.032629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:05.047276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d93d2-ee08-4769-98cc-9640dac16dee admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.169065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.170604 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.171057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.171489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] PATH_INFO: `/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.173080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f0c1ee26c54ed2b48e19ffd8e1ce5a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.175543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.247078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f0c1ee26c54ed2b48e19ffd8e1ce5a', 'request_id': 'req-01f6fc35-477a-49d2-9415-f55f0bb14e7d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:05.261970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f0c1ee26c54ed2b48e19ffd8e1ce5a', 'request_id': 'req-01f6fc35-477a-49d2-9415-f55f0bb14e7d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:05.270489 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f0c1ee26c54ed2b48e19ffd8e1ce5a', 'request_id': 'req-01f6fc35-477a-49d2-9415-f55f0bb14e7d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:05.287628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] The token cache is being invalidate because project 71f0c1ee26c54ed2b48e19ffd8e1ce5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:05.288208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:05.289074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-01f6fc35-477a-49d2-9415-f55f0bb14e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:05.291117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1110/2215] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:05 2022] DELETE /identity/v3/projects/71f0c1ee26c54ed2b48e19ffd8e1ce5a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:05.297278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.297847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.298004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.339913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:05.341391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:05.433920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1106/2216] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:05.439503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.440610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.441719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.467485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:05.468945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:05.480600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1111/2217] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:05.487649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.498399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edd3f4-d09a-4f55-a3d4-485e70ec61c8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.504277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.505476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.506142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.506425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.507164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:05.507484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.509095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.523876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1107/2218] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:05.528214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.540707 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd195c-0535-4e7c-bb9e-a01542936460 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.556671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.558215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.558901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.559580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.561227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.565559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.618372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1112/2219] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:05 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:05.623356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.649263 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc039-20c9-4370-8af4-2383d3d4842d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.776014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.777191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.777698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.778215 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.779142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.781252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.809714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1108/2220] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:05 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:05.815516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.829310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182117d1-c61f-4f22-8df7-50d828b8950a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.842171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.843002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.843281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.843614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.844414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.846380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.869823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1113/2221] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:05.875683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.892738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6a20-e3d0-4064-8854-7f61f3473c21 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.900843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.901956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.902376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.902747 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.903609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.909834 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d831-21f0-4a12-8e7e-b58a74e98f82 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:05.925460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1109/2222] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:05.926053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:05.941221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba5dc-cf76-486d-a51b-fc85a1715dfc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:05.958855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:05.960200 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:05.960726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:05.961181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] PATH_INFO: `/v3/projects/1af79b1e3e594cf68fbf7b80cfc96795/users/728f3553c05e45e2a5957d18705efee6/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:05.992276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af79b1e3e594cf68fbf7b80cfc96795, user_id=728f3553c05e45e2a5957d18705efee6, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:05.999575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.043786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1114/2223] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:05 2022] PUT /identity/v3/projects/1af79b1e3e594cf68fbf7b80cfc96795/users/728f3553c05e45e2a5957d18705efee6/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:06.059235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.059475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.059911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.129449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] MFA Rules not processed for user `728f3553c05e45e2a5957d18705efee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:06.131639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:06.317598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1110/2224] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:06.318391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.434662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f821-fc8d-46fc-8bbf-6d646d90fff3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.442992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.444705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.445107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.445474 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.446222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.448122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.482939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1115/2225] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:06.487405 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.500012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8be41-2a18-4272-82b4-48a40b2233b8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.571167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.571850 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.572147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.572537 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.573375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.575357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.610338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1111/2226] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:06.615025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.635480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4a22f-cb01-434f-b7a5-89e5264ab872 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.643464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.644691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.645212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.647081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.647081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.650265 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.678843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1116/2227] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:06.679790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.692220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bd0b-91a8-48d2-9dac-801c74bc101c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.701789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.702753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.703167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.703654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.704649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.706753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556df5f-ce2b-474a-a703-d151fff8db70 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.722384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1112/2228] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:06.728376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.744120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77582c-296f-4595-af88-7d366114590f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.751697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.753322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.753850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.754406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] PATH_INFO: `/v3/projects/26915d742d1845629873e83e5a14d442/users/e00df2f1c8d94505898742485682857a/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.778206 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26915d742d1845629873e83e5a14d442, user_id=e00df2f1c8d94505898742485682857a, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.784542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.800556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1117/2229] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:06 2022] PUT /identity/v3/projects/26915d742d1845629873e83e5a14d442/users/e00df2f1c8d94505898742485682857a/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:06.813953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.814379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.814854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.851696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] MFA Rules not processed for user `e00df2f1c8d94505898742485682857a`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:06.853604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:06.954232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1113/2230] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:06.959917 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.071990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286fe3-5862-440e-bbb6-d1af772aaceb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.077629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.078195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.078607 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.078750 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.079542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.081414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.125562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1118/2231] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:07.126673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.139772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af205e5-fa9d-40c4-8116-73f2f73c4eae None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.212143 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.212760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.213050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.213330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.214245 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.216231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.254789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1114/2232] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:07 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:07.257137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.280098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b9fbd-9d88-46c7-861b-f0a27ca85b61 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.285974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.286723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.287024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.287316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.288219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.290083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.307820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1119/2233] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:07.308883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.320849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5e199-9392-4f0b-ad2b-832a92c37e1d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.330836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.330836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.330836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.330836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] PATH_INFO: `/v3/projects/f0431d99b316458cb2f612a89b1dfc00/users/acee6728ce9a43e8889cdd60dd88e1f2/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.354042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0431d99b316458cb2f612a89b1dfc00, user_id=acee6728ce9a43e8889cdd60dd88e1f2, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.357507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.378461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1115/2234] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:07 2022] PUT /identity/v3/projects/f0431d99b316458cb2f612a89b1dfc00/users/acee6728ce9a43e8889cdd60dd88e1f2/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:07.382972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.407372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76133e-a000-4984-8f12-23575d94ca17 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.502997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.503703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.503987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.504327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.505076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.506921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467ca89-21c0-4623-be5e-254c573d6a38 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.536166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1120/2235] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:07.540707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.560945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24656d-bb44-45b7-b43e-34d5797fde9c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.582309 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.583385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.583715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.584055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] PATH_INFO: `/v3/projects/f0431d99b316458cb2f612a89b1dfc00/users/acee6728ce9a43e8889cdd60dd88e1f2/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.590770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0431d99b316458cb2f612a89b1dfc00, user_id=acee6728ce9a43e8889cdd60dd88e1f2, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.594471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.623611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1116/2236] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:07 2022] PUT /identity/v3/projects/f0431d99b316458cb2f612a89b1dfc00/users/acee6728ce9a43e8889cdd60dd88e1f2/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:07.640645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.640929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.641209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.719018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] MFA Rules not processed for user `acee6728ce9a43e8889cdd60dd88e1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:07.720178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:07.833858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1121/2237] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:07 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:07.855153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.859279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:07.958462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25163bb-2e55-4cf1-80e7-caefa04aa31d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.962133 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.962955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.966020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.966020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.984433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.986918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7afc3-636c-46e6-a457-687eb56ea0fd service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:08.003195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1117/2238] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:08.064259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:08.080243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f955eb-e261-48ce-8b75-d443092040bd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:08.086310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:08.087358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:08.087897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:08.088181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:08.158710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:08.160484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:08.180012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1122/2239] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:08 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:08.961188 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:08.962161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:08.962615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:09.006564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:09.008296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:09.093914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1118/2240] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:04:08 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:09.126147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:09.128359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:09.217915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862ef11-bfef-468e-b180-70f59bced925 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:09.223980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:09.225004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:09.225282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:09.225733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:09.237778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:09.239731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bf8e9-3ac5-41bb-bb4b-1eba271746f4 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:09.250259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1123/2241] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:04:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:13.431197 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:13.550377 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c10a65-5dc7-4c1e-8fc2-c13b112374fc None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:13.563499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:13.565406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:13.566053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:13.566581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] PATH_INFO: `/v3/users/728f3553c05e45e2a5957d18705efee6` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:13.568655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728f3553c05e45e2a5957d18705efee6)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:13.571591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:13.652275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728f3553c05e45e2a5957d18705efee6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:13.652934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728f3553c05e45e2a5957d18705efee6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:13.653736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728f3553c05e45e2a5957d18705efee6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:13.689247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728f3553c05e45e2a5957d18705efee6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:13.700185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-89fab748-7c78-41e3-9854-74304ad85a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728f3553c05e45e2a5957d18705efee6'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:13.726578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1119/2242] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:13 2022] DELETE /identity/v3/users/728f3553c05e45e2a5957d18705efee6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:13.729115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:13.729655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:13.730004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:13.769383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:13.771695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:13.899560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:13.900480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:13.901243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:13.927646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1124/2243] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:13.936209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:13.938283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:13.939427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:13.940590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:14.032341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7b25-565e-4f41-aadb-2db64e7c5ff2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:14.036717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:14.037518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:14.037974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:14.038357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:14.059996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:14.063222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:14.100991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1125/2244] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:14.116808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1120/2245] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:04:13 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:14.144975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:14.146532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:14.315834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3bb5-c62a-4b1d-801f-8f197bcf333f service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:14.325066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:14.325794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:14.326081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:14.326364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:14.349635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:14.351965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:14.364274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1126/2246] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:14.683073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:14.685174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:14.722432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50115f3-6a31-4d3d-b545-29679261d5dd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:14.752316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:14.753494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:14.754080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:14.754614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] PATH_INFO: `/v3/projects/1af79b1e3e594cf68fbf7b80cfc96795` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:14.756727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af79b1e3e594cf68fbf7b80cfc96795)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:14.759438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:14.924905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af79b1e3e594cf68fbf7b80cfc96795', 'request_id': 'req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:14.938516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af79b1e3e594cf68fbf7b80cfc96795', 'request_id': 'req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:14.954157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af79b1e3e594cf68fbf7b80cfc96795', 'request_id': 'req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:14.979962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] The token cache is being invalidate because project 1af79b1e3e594cf68fbf7b80cfc96795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:14.980556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:14.981638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:14.988708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:14.989632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1121/2247] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:14 2022] DELETE /identity/v3/projects/1af79b1e3e594cf68fbf7b80cfc96795 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:15.012251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43c38-31fd-4d39-95e4-2429b79f72b8 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:15.160985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:15.162842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.163166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.163532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] PATH_INFO: `/v3/users/e00df2f1c8d94505898742485682857a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.165542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00df2f1c8d94505898742485682857a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:15.167927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:15.311243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00df2f1c8d94505898742485682857a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:15.312488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00df2f1c8d94505898742485682857a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:15.313366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00df2f1c8d94505898742485682857a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:15.326457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00df2f1c8d94505898742485682857a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:15.335572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00df2f1c8d94505898742485682857a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:15.371757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1127/2248] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:14 2022] DELETE /identity/v3/users/e00df2f1c8d94505898742485682857a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:16.994068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:16.997814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:17.020797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea75b8-a20e-42f5-a79c-67fd7dfac21a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:17.184753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:17.187110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:17.191190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:17.191708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] PATH_INFO: `/v3/projects/26915d742d1845629873e83e5a14d442` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:17.193426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=26915d742d1845629873e83e5a14d442)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:17.201272 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:17.339453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26915d742d1845629873e83e5a14d442', 'request_id': 'req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.367488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26915d742d1845629873e83e5a14d442', 'request_id': 'req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.401386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26915d742d1845629873e83e5a14d442', 'request_id': 'req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.418355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] The token cache is being invalidate because project 26915d742d1845629873e83e5a14d442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:17.418659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.419477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.425193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1122/2249] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:16 2022] DELETE /identity/v3/projects/26915d742d1845629873e83e5a14d442 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:17.426805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:17.428924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:17.449833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5e956-8006-4b40-b753-6826b2f3500f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:17.627143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:17.629320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:17.629710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:17.630049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] PATH_INFO: `/v3/users/acee6728ce9a43e8889cdd60dd88e1f2` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:17.648605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=acee6728ce9a43e8889cdd60dd88e1f2)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:17.651068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:17.803251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acee6728ce9a43e8889cdd60dd88e1f2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.804472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acee6728ce9a43e8889cdd60dd88e1f2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.805523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acee6728ce9a43e8889cdd60dd88e1f2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.828337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acee6728ce9a43e8889cdd60dd88e1f2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.849855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acee6728ce9a43e8889cdd60dd88e1f2'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:17.909592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1128/2250] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:17 2022] DELETE /identity/v3/users/acee6728ce9a43e8889cdd60dd88e1f2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:18.216957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:18.221327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:18.585996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31ca9-0d9c-40ec-8258-a02cd39e32ea admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:18.721374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:18.723036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:18.828753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:18.830366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:18.830664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:18.830935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:18.834302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:18.854798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:18.862161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc98696-b19f-48ab-8b82-5420c9085cb5 service placement] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:18.883595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1123/2251] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:18 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:18.949839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99269e5-2048-4db3-8491-1ffef63daf3d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:18.964948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:18.965970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:18.967468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:18.967760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] PATH_INFO: `/v3/projects/f0431d99b316458cb2f612a89b1dfc00` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:18.970483 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0431d99b316458cb2f612a89b1dfc00)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:18.979727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:19.167939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0431d99b316458cb2f612a89b1dfc00', 'request_id': 'req-8eea2eea-d4fa-4458-a051-000940884f72'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:19.205188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0431d99b316458cb2f612a89b1dfc00', 'request_id': 'req-8eea2eea-d4fa-4458-a051-000940884f72'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:19.218997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0431d99b316458cb2f612a89b1dfc00', 'request_id': 'req-8eea2eea-d4fa-4458-a051-000940884f72'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:19.264008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] The token cache is being invalidate because project f0431d99b316458cb2f612a89b1dfc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:19.264517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:19.265870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8eea2eea-d4fa-4458-a051-000940884f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:19.280115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1129/2252] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:18 2022] DELETE /identity/v3/projects/f0431d99b316458cb2f612a89b1dfc00 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:19.294010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:19.294609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:19.295440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:19.385782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:19.389591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:19.549074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1124/2253] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:19.558473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:19.558768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:19.559056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:19.611743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:19.613613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:19.656783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1130/2254] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:19.662514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:19.689521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a755-7b2e-40ab-b059-48b0f3a765c1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:19.697593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:19.698328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:19.698750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:19.699046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:19.699780 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:19.700090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:19.703817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:19.723549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1125/2255] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:19.727901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:19.748401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d131b-a2b9-4d9b-8270-5c380e24cb8a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:19.760252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:19.761032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:19.761591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:19.762042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:19.763224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:19.769022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:19.859220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1131/2256] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:19 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:19.862011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:19.882242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aead69-7c2a-40a2-9ebc-e3926fb40eda admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:20.048969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:20.048969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:20.048969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:20.048969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:20.049421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:20.051289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:20.113146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1126/2257] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:19 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:20.114661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:20.160193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebded38-753c-4761-9e78-57a40e016c67 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:20.178261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:20.180125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:20.181179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:20.182000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:20.185776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:20.191588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:20.225099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1132/2258] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:20.229160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:20.242159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca7b3-e8c6-4a4d-afb0-6cca24845727 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:20.271445 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:20.272258 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:20.272543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:20.272823 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:20.273575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:20.275614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837b9c-5491-4793-b8aa-8f12dee30f8f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:20.329737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1127/2259] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:20.330590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:20.342786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44b5fa-691b-4b5c-8e7b-3f1ceb228fc4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:20.369490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:20.370452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:20.370733 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:20.371008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] PATH_INFO: `/v3/projects/ef89d68d088843c69daf6d14a317257c/users/26824b810b044f5f8768e4bb5341d346/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:20.434230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef89d68d088843c69daf6d14a317257c, user_id=26824b810b044f5f8768e4bb5341d346, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:20.437449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:20.479078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1133/2260] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:20 2022] PUT /identity/v3/projects/ef89d68d088843c69daf6d14a317257c/users/26824b810b044f5f8768e4bb5341d346/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:20.496000 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:20.496294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:20.496564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:20.583032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] MFA Rules not processed for user `26824b810b044f5f8768e4bb5341d346`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:20.584355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:20.814852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1128/2261] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:20 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:20.822874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:20.825868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:21.039361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ee3e4-c0a0-4c94-a7d0-0dc02a32f48b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:21.056863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:21.059884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:21.062854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:21.064230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:21.085868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:21.089796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4b9ca-815d-42e6-9493-3342efe5c434 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:21.111736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1134/2262] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:20 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:21.160283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:21.324035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb09a-711c-480e-8a62-76a3d5db85bc None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:21.343866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:21.344952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:21.346560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:21.346950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] PATH_INFO: `/v3/users/26824b810b044f5f8768e4bb5341d346` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:21.354052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26824b810b044f5f8768e4bb5341d346)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:21.361234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:21.489335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26824b810b044f5f8768e4bb5341d346'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:21.489673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26824b810b044f5f8768e4bb5341d346'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:21.490725 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26824b810b044f5f8768e4bb5341d346'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:21.505505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26824b810b044f5f8768e4bb5341d346'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:21.518713 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26824b810b044f5f8768e4bb5341d346'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:21.543858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1129/2263] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:21 2022] DELETE /identity/v3/users/26824b810b044f5f8768e4bb5341d346 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:21.546166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:21.546461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:21.546744 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:21.584064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:21.585430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:21.715222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1135/2264] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:21 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:21.731086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:21.734358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:21.844365 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb9a7-e63a-429b-b6b1-cbe63f7b6380 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:21.848368 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:21.849032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:21.849373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:21.849662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:21.861463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:21.863297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:21.877669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1130/2265] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:04:22.606238 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:22.613472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:22.686284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710aae-e0e6-4d4e-a6f1-4fc15610a718 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:22.711351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:22.721397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:22.721960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:22.723050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] PATH_INFO: `/v3/projects/ef89d68d088843c69daf6d14a317257c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:22.734756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef89d68d088843c69daf6d14a317257c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:22.738145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:23.025176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef89d68d088843c69daf6d14a317257c', 'request_id': 'req-1260a3fb-3bae-4581-9e23-dafb5932199e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:23.038193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef89d68d088843c69daf6d14a317257c', 'request_id': 'req-1260a3fb-3bae-4581-9e23-dafb5932199e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:23.063087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef89d68d088843c69daf6d14a317257c', 'request_id': 'req-1260a3fb-3bae-4581-9e23-dafb5932199e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:23.137783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] The token cache is being invalidate because project ef89d68d088843c69daf6d14a317257c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:23.138213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:23.138956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1260a3fb-3bae-4581-9e23-dafb5932199e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:23.140743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1136/2266] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:22 2022] DELETE /identity/v3/projects/ef89d68d088843c69daf6d14a317257c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:25.000158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:25.002226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:25.027750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceb27d-23ae-4c7d-abf3-bfdce9bca33d service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:25.137277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:25.139091 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:25.139555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:25.140291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] PATH_INFO: `/v3/users/cf8b9f8da902497881dd112d0ad3f4a1` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:25.141842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8b9f8da902497881dd112d0ad3f4a1)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:25.144052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:25.234806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8b9f8da902497881dd112d0ad3f4a1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:25.235565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8b9f8da902497881dd112d0ad3f4a1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:25.236338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8b9f8da902497881dd112d0ad3f4a1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:25.262244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8b9f8da902497881dd112d0ad3f4a1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:25.273187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8b9f8da902497881dd112d0ad3f4a1'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:25.302992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1131/2267] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:24 2022] DELETE /identity/v3/users/cf8b9f8da902497881dd112d0ad3f4a1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:25.304627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:25.305127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:25.305228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:25.329670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:25.331350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:25.411022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1137/2268] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:25.439893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:25.442375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:25.564327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42726d3-a23c-48f2-ac81-e54a56c360b7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:25.570875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:25.571675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:25.572518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:25.572873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:25.592515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:25.594279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85609-bb95-4ac5-8bbe-75a68727367f service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:25.606536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1132/2269] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:26.720562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:26.723801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:26.752800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944951bc-0d32-458d-82d2-e8ecafb294e0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:26.760216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:26.761274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:26.761661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:26.762011 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] PATH_INFO: `/v3/projects/031aabfc41fb4aca9ca7fbc468dbbd74` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:26.764143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031aabfc41fb4aca9ca7fbc468dbbd74)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:26.766286 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:26.861263 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031aabfc41fb4aca9ca7fbc468dbbd74', 'request_id': 'req-18d76da8-2e39-462e-b996-6a1c5910ce50'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:26.874352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031aabfc41fb4aca9ca7fbc468dbbd74', 'request_id': 'req-18d76da8-2e39-462e-b996-6a1c5910ce50'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:26.882109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031aabfc41fb4aca9ca7fbc468dbbd74', 'request_id': 'req-18d76da8-2e39-462e-b996-6a1c5910ce50'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:26.901642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] The token cache is being invalidate because project 031aabfc41fb4aca9ca7fbc468dbbd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:26.901979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:26.905069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-18d76da8-2e39-462e-b996-6a1c5910ce50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:26.907019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1138/2270] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:26 2022] DELETE /identity/v3/projects/031aabfc41fb4aca9ca7fbc468dbbd74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:26.913396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:26.914827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:26.915436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:26.978308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:26.980362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:27.158139 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1133/2271] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:27.161509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.161887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.163479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.195671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:27.196992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:27.245022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1139/2272] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:27.249853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.271115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3e2a5-fa51-44af-b875-c72480f4434c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.276358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.277073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.277505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.277830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.278929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:27.278929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.280577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.309380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1134/2273] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:04:27.311606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.322018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c467f-3951-4bd2-994e-79e46eaa48ae None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.328675 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.329453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.330250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.330662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.331442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.337406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.400292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1140/2274] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:27 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:27.401845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.417572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563898ae-f686-43b5-926f-1ee0391c780a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.518679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.519280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.519566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.519902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.520627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.534015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.580579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1135/2275] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:27 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:27.582039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.596819 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c49648-6933-491d-81ac-4c179e6a8b17 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.601654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.602364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.602646 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.602922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.603650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.605250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.647767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1141/2276] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:27.650612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.661824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d454-355f-4a0e-b865-0f3abc334677 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.667287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.667985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.668331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.668587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.670038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.670993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981fac0-089b-4357-bba5-561889318362 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.684173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1136/2277] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:27.689781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.702306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6ed3-7698-4c3a-bdbe-701a737f594a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:27.707990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:27.709162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.709546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.709960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] PATH_INFO: `/v3/projects/d1a75bb39bc04811a63f88b4855ea3c1/users/1e19e09d723e49be92b5f4f7162c19b8/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.737355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a75bb39bc04811a63f88b4855ea3c1, user_id=1e19e09d723e49be92b5f4f7162c19b8, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:27.740259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:27.771816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1142/2278] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:27 2022] PUT /identity/v3/projects/d1a75bb39bc04811a63f88b4855ea3c1/users/1e19e09d723e49be92b5f4f7162c19b8/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:27.775863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:27.776310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:27.776924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:27.834382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] MFA Rules not processed for user `1e19e09d723e49be92b5f4f7162c19b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:27.836750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:27.967916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1137/2279] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:27 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:27.980271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:27.982045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:28.052354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20936ed4-d3db-4f5b-b2f5-de600d9bf6a7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:28.056104 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:28.056627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:28.056907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:28.057178 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:28.068161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:28.068596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c984f8-a856-4a39-8d7b-09fdb511a2c5 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:28.079546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1143/2280] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:27 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:28.110556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:28.183750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c2c1c-54b9-4923-a117-8f5654964cca None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:28.189577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:28.190512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:28.190800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:28.191193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] PATH_INFO: `/v3/users/1e19e09d723e49be92b5f4f7162c19b8` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:28.192362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e19e09d723e49be92b5f4f7162c19b8)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:28.194457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:28.258542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e19e09d723e49be92b5f4f7162c19b8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:28.259206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e19e09d723e49be92b5f4f7162c19b8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:28.260274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e19e09d723e49be92b5f4f7162c19b8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:28.276316 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e19e09d723e49be92b5f4f7162c19b8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:28.292357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e19e09d723e49be92b5f4f7162c19b8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:28.314362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1138/2281] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:28 2022] DELETE /identity/v3/users/1e19e09d723e49be92b5f4f7162c19b8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:28.318751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:28.319129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:28.319485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:28.339297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:28.341382 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:28.415044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1144/2282] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:28.425671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:28.427275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:28.507115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b09857-f95a-4a7a-9fbf-e7988b51ff54 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:28.512455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:28.513714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:28.514385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:28.514749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:28.527746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:28.530602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4f17-2750-4658-b5ce-0718a0cfe92e service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:28.544213 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1139/2283] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:29.082664 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:29.084362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:29.103749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56b64f-51b6-413a-ac36-d03394e30e4f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:29.126327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:29.127046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:29.127240 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:29.127527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] PATH_INFO: `/v3/projects/d1a75bb39bc04811a63f88b4855ea3c1` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:29.129897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a75bb39bc04811a63f88b4855ea3c1)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:29.132679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:29.232823 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a75bb39bc04811a63f88b4855ea3c1', 'request_id': 'req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:29.241883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a75bb39bc04811a63f88b4855ea3c1', 'request_id': 'req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:29.262435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a75bb39bc04811a63f88b4855ea3c1', 'request_id': 'req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:29.290137 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] The token cache is being invalidate because project d1a75bb39bc04811a63f88b4855ea3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:29.294143 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:29.296139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-bcd8eb15-5a9f-46eb-89a4-4be90393fd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:29.300843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1145/2284] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:29 2022] DELETE /identity/v3/projects/d1a75bb39bc04811a63f88b4855ea3c1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:30.615024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:30.616098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:30.616711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] PATH_INFO: `/` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:30.619346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1140/2285] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:04:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:30.626290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2b9b-c871-4572-96e7-90d4f69637d6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:30.627063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2b9b-c871-4572-96e7-90d4f69637d6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:30.627361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2b9b-c871-4572-96e7-90d4f69637d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:30.772971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-586f2b9b-c871-4572-96e7-90d4f69637d6 None None] MFA Rules not processed for user `77efb1f35bc948b1b218f0ae9deca0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:30.779055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-586f2b9b-c871-4572-96e7-90d4f69637d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:30.978436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1146/2286] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 02:04:30.991816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:30.993798 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.113510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255393ee-a7ca-4880-83b3-33797e8d96a6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.117855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.118595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.118884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.119199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.131735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.133439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42228-e45a-4868-b85f-3c1d7da50be4 service glance] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.147344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1141/2287] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:30 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:31.245044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.245336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.245619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.248567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1147/2288] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:31.277710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0502e-eac4-48a8-9b34-6d9b2482b8e2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.278179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0502e-eac4-48a8-9b34-6d9b2482b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.278465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0502e-eac4-48a8-9b34-6d9b2482b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.313281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-67a0502e-eac4-48a8-9b34-6d9b2482b8e2 None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:31.314953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-67a0502e-eac4-48a8-9b34-6d9b2482b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.410387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.412581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.419960 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1142/2289] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:31.442937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848e077-542c-498e-9a4f-917c7474d0f9 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.448576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.449393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.449849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.450218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.472771 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.474812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.484468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1148/2290] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:35.475848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057acc-c20d-4ab4-8bcc-a9fa2e77052b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:35.477788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057acc-c20d-4ab4-8bcc-a9fa2e77052b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:35.477788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86057acc-c20d-4ab4-8bcc-a9fa2e77052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:35.502789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-86057acc-c20d-4ab4-8bcc-a9fa2e77052b None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:35.506427 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-86057acc-c20d-4ab4-8bcc-a9fa2e77052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:35.589239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1143/2291] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:04:35 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:35.612520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:35.614310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:35.716990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4efa-d762-468d-9339-37a355d7a073 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:35.724891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:35.725688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:35.726180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:35.726458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:35.735892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:35.737610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:35.748816 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1149/2292] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:38.215664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.216605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.216892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.288570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:38.290004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:38.321962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1144/2293] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:04:38 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:38.330597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:38.353825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914462-a0ea-46d6-984f-e53ffa51004d service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:38.360626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:38.361442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.361854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.362358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.371821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:38.374486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:38.385614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1150/2294] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:04:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:40.918730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.922042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.037704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e2e83-b8cc-4ec1-a418-a672f955b031 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.042959 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.044160 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.044455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.044734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] PATH_INFO: `/v3/users/1f85e8545e634ff99938a4c9dfa1bd2c` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.046704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f85e8545e634ff99938a4c9dfa1bd2c)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.048676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.122970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f85e8545e634ff99938a4c9dfa1bd2c'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.124051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f85e8545e634ff99938a4c9dfa1bd2c'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.124705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f85e8545e634ff99938a4c9dfa1bd2c'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.135548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f85e8545e634ff99938a4c9dfa1bd2c'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.146041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f85e8545e634ff99938a4c9dfa1bd2c'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.165115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1145/2295] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:40 2022] DELETE /identity/v3/users/1f85e8545e634ff99938a4c9dfa1bd2c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:41.365351 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:41.387758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfe263-4982-47fc-90c9-6dfae339ddf4 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.475721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.476779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.477301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.477792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] PATH_INFO: `/v3/projects/db6ea7ebf03d4ba89b2158cb1610b391` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.479055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6ea7ebf03d4ba89b2158cb1610b391)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.481002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.548245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6ea7ebf03d4ba89b2158cb1610b391', 'request_id': 'req-8db96bf9-164b-4903-a009-81bc92118d1f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.556599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6ea7ebf03d4ba89b2158cb1610b391', 'request_id': 'req-8db96bf9-164b-4903-a009-81bc92118d1f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.568586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6ea7ebf03d4ba89b2158cb1610b391', 'request_id': 'req-8db96bf9-164b-4903-a009-81bc92118d1f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.578782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] The token cache is being invalidate because project db6ea7ebf03d4ba89b2158cb1610b391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:41.579067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.579933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.581482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1151/2296] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:41 2022] DELETE /identity/v3/projects/db6ea7ebf03d4ba89b2158cb1610b391 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:45.775851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:45.780466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:45.796387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8c352-5893-4158-b5b2-bfa0f40a8325 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:45.852635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:45.853418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:45.853825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:45.854011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] PATH_INFO: `/v3/users/9717e2ab2be74631aba4b196112bf984` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:45.855319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9717e2ab2be74631aba4b196112bf984)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:45.857221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:45.902223 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9717e2ab2be74631aba4b196112bf984'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:45.902876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9717e2ab2be74631aba4b196112bf984'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:45.903466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9717e2ab2be74631aba4b196112bf984'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:45.911253 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9717e2ab2be74631aba4b196112bf984'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:45.918031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a4fc0967-4534-437c-b91f-970e907c1744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9717e2ab2be74631aba4b196112bf984'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:45.934659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1146/2297] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:45 2022] DELETE /identity/v3/users/9717e2ab2be74631aba4b196112bf984 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:46.118561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.120144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:46.137221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db96bf9-164b-4903-a009-81bc92118d1f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.202634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.203538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.203826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.204274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] PATH_INFO: `/v3/projects/6639261ee8ee46e0a4e3a01eb63b9ab4` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.206308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6639261ee8ee46e0a4e3a01eb63b9ab4)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.208875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.258277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'request_id': 'req-f7cd21e9-4416-4895-87e5-be747f1b1978'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:46.265822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'request_id': 'req-f7cd21e9-4416-4895-87e5-be747f1b1978'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:46.272932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6639261ee8ee46e0a4e3a01eb63b9ab4', 'request_id': 'req-f7cd21e9-4416-4895-87e5-be747f1b1978'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:46.286645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] The token cache is being invalidate because project 6639261ee8ee46e0a4e3a01eb63b9ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:46.286828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:46.287448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-f7cd21e9-4416-4895-87e5-be747f1b1978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:46.289261 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1152/2298] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:46 2022] DELETE /identity/v3/projects/6639261ee8ee46e0a4e3a01eb63b9ab4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:46.294870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.295734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.296014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.313046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:46.314310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:46.372355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1147/2299] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:46.380717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.381008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.381332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.402115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:46.403330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:46.411699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1153/2300] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:46.415695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.425170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41236-761b-442e-8b34-f2cf535604bf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.429882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.430571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.430858 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.431140 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.431866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:46.432182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.433830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.446222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1148/2301] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:46.450376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.460245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c6b0-ecbc-4686-947d-507f09386a26 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.464949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.465602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.465922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.466203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.466942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.468822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.499014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1154/2302] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:46.504826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.515668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa34d8a-6461-49dc-89e9-58edf59bf136 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.570855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.571525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.571830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.572108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.572788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.574785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.593110 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1149/2303] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:46.597145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.607012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dbf3d-9e92-4897-8b90-30c7facff488 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.612088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.612742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.613026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.613306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.614064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.615642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.626446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1155/2304] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:46.629924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.639453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d722-cbbd-4b90-a665-c105338dd43c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.644030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.644676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.644961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.645242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.645999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.647573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6beb5-3395-4ee7-9495-90cb1a53e20a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.657002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1150/2305] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:46.665689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.684223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf525a5e-cfaa-45ca-8046-b1008f9ec8d7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.690631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.691541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.691820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.692097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] PATH_INFO: `/v3/projects/fc2de1c255d84760a184e79be7a1281a/users/01537dba7cf1422e8b37eddb5cc2a7ba/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.708134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2de1c255d84760a184e79be7a1281a, user_id=01537dba7cf1422e8b37eddb5cc2a7ba, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.710783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.724033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1156/2306] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:46 2022] PUT /identity/v3/projects/fc2de1c255d84760a184e79be7a1281a/users/01537dba7cf1422e8b37eddb5cc2a7ba/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:46.734932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.735228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.735509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.761650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] MFA Rules not processed for user `01537dba7cf1422e8b37eddb5cc2a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:46.762918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:46.825506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1151/2307] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:46.830160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.889587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c5150-de2f-438f-b3c1-44c9c63daddd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:46.894184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:46.894837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:46.895117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:46.895388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:46.896062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:46.897945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:46.925317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1157/2308] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:46.926345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:46.937695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06473-c875-4a79-a4b5-b9c0bd50f30b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.004799 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.005870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.006303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.006729 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.007812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.010508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.036645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1152/2309] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:46 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:47.037922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.048279 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b4dd-23ad-4c72-8c54-45d90853428e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.054321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.054997 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.055277 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.055557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.056294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.057894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.070220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1158/2310] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:47.074164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.085228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd51f-ad4b-4cbf-a869-f63adf849383 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.089861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.090748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.091033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.091314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] PATH_INFO: `/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8/users/bf945aba063845baaf7523b5466cc368/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.105453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ffa1dcbe484cd88cdc202b56864fa8, user_id=bf945aba063845baaf7523b5466cc368, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.108185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.121310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1153/2311] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:47 2022] PUT /identity/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8/users/bf945aba063845baaf7523b5466cc368/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:47.126624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.136436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ea678-af94-4912-a4c9-77cb63d7fd36 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.192418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.193094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.193376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.193650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.194408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.196122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803619e-cc23-491d-a950-26487d2ea42f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.206938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1159/2312] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:47.210968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.223483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ed8f-82e4-4ff9-897e-600ca3fc419a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.228308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.229374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.229658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.229969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] PATH_INFO: `/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8/users/bf945aba063845baaf7523b5466cc368/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.231920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ffa1dcbe484cd88cdc202b56864fa8, user_id=bf945aba063845baaf7523b5466cc368, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.234563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.245573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1154/2313] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:47 2022] PUT /identity/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8/users/bf945aba063845baaf7523b5466cc368/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:47.258701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.259095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.259452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.287884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] MFA Rules not processed for user `bf945aba063845baaf7523b5466cc368`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:47.289121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:47.370893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1160/2314] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:47 2022] POST /identity/v3/auth/tokens => generated 3450 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:47.384984 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.387370 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:47.456571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c744c-e0b6-48f2-b9d6-9cc01208999e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.460361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.461013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.461290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.461562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.473082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.474843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62850449-598c-42c8-9529-5a64aa8b7a3d service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.488183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1155/2315] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:47 2022] GET /identity/v3/auth/tokens => generated 3450 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:47.669459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.739757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6aa0-d25c-4396-a1b2-6bb24b447865 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:47.749482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:47.749482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.749482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.749482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] PATH_INFO: `/v3/users/01537dba7cf1422e8b37eddb5cc2a7ba` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.750392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01537dba7cf1422e8b37eddb5cc2a7ba)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:47.752642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:47.810418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01537dba7cf1422e8b37eddb5cc2a7ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:47.811121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01537dba7cf1422e8b37eddb5cc2a7ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:47.811725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01537dba7cf1422e8b37eddb5cc2a7ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:47.823372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01537dba7cf1422e8b37eddb5cc2a7ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:47.832705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01537dba7cf1422e8b37eddb5cc2a7ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:47.854709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1161/2316] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:47 2022] DELETE /identity/v3/users/01537dba7cf1422e8b37eddb5cc2a7ba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:47.859728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:47.860239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:47.860346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:47.881507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:47.883016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:47.951176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1156/2317] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:47.962752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:47.964647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.024563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f7afa-fb3d-4c37-9c2f-c8c5dfc5e1c7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.028540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.029689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.030014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.030295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.039091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.040509 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.050594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1162/2318] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:48.361425 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.363002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.381572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0010d-5736-4879-b4f5-e05d295dd52c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.390277 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.391230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.391544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.391847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] PATH_INFO: `/v3/projects/fc2de1c255d84760a184e79be7a1281a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.393217 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2de1c255d84760a184e79be7a1281a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.395144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.443105 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2de1c255d84760a184e79be7a1281a', 'request_id': 'req-e71c0f24-d83c-4754-808c-a26e5968fd2e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.450586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2de1c255d84760a184e79be7a1281a', 'request_id': 'req-e71c0f24-d83c-4754-808c-a26e5968fd2e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.457289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2de1c255d84760a184e79be7a1281a', 'request_id': 'req-e71c0f24-d83c-4754-808c-a26e5968fd2e'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.466967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] The token cache is being invalidate because project fc2de1c255d84760a184e79be7a1281a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:48.467254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.467876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.469403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1157/2319] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/projects/fc2de1c255d84760a184e79be7a1281a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:48.473519 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.483064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e192b9b-545c-4713-a38e-b723346c98fe service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.537879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.538749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.539055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.539328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] PATH_INFO: `/v3/users/bf945aba063845baaf7523b5466cc368` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.540505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf945aba063845baaf7523b5466cc368)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.542461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.588943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf945aba063845baaf7523b5466cc368'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.589592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf945aba063845baaf7523b5466cc368'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.590221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf945aba063845baaf7523b5466cc368'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.597404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf945aba063845baaf7523b5466cc368'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.604338 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-685f7a5f-c2de-4125-b426-35e52721b797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf945aba063845baaf7523b5466cc368'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.621317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1163/2320] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/users/bf945aba063845baaf7523b5466cc368 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:48.943568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.945175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.958157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c0f24-d83c-4754-808c-a26e5968fd2e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.018670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.019455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.019740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.020011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] PATH_INFO: `/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.021237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ffa1dcbe484cd88cdc202b56864fa8)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.023203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.078565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ffa1dcbe484cd88cdc202b56864fa8', 'request_id': 'req-98d60866-efd8-4976-afba-43c948b89e35'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.085869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ffa1dcbe484cd88cdc202b56864fa8', 'request_id': 'req-98d60866-efd8-4976-afba-43c948b89e35'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.092869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ffa1dcbe484cd88cdc202b56864fa8', 'request_id': 'req-98d60866-efd8-4976-afba-43c948b89e35'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.103282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] The token cache is being invalidate because project a6ffa1dcbe484cd88cdc202b56864fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:49.103693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.104349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-98d60866-efd8-4976-afba-43c948b89e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.105925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1158/2321] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/projects/a6ffa1dcbe484cd88cdc202b56864fa8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:49.111647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.111935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.112214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.130531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:49.131865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:49.188484 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1164/2322] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:49.196641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.196936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.197234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.216199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:49.217417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:49.225660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1159/2323] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:49.229875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.239290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b260522-bb8f-4967-9be0-ac4632c37755 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.243864 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.244517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.244803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.245083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.245828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:49.246141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.247727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.259631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1165/2324] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:49.264540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.273958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f54e4-ecf1-4bf8-81b9-8cc2b94cbe9f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.278876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.279542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.279824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.280103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.280794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.282745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.308902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1160/2325] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:49.313613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.323985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeffeab-4512-4933-b4a0-f203d576028d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.381105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.381846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.382132 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.382410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.383109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.385033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.413837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1166/2326] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:49.418516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.431919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9782e-3023-4fe2-bc1f-f499b4eeec0d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.439249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.440520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.440953 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.441380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.442561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.445135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.459214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1161/2327] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:49.463503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.475427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6cbd8-4206-4fc9-9838-56ad050de228 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.480320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.481038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.481321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.481601 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.482482 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.484068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f4133-4e08-4ec5-b136-d5d4ea6b3f1f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.494064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1167/2328] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:49.498999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.511612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682cd72-7640-4961-b64d-c2ec2466c7b4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.516876 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.517789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.518077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.518353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] PATH_INFO: `/v3/projects/8e439b082505441682afef1b4b97dd7d/users/c50c7d6c50f4461192ba61ab8ec0a442/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.532321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e439b082505441682afef1b4b97dd7d, user_id=c50c7d6c50f4461192ba61ab8ec0a442, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.534926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.548409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1162/2329] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:49 2022] PUT /identity/v3/projects/8e439b082505441682afef1b4b97dd7d/users/c50c7d6c50f4461192ba61ab8ec0a442/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:49.559848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.560139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.560418 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.587405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] MFA Rules not processed for user `c50c7d6c50f4461192ba61ab8ec0a442`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:49.588635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:49.648922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1168/2330] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:49.653505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.712326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87db74f-6c4f-43e1-9264-8bfbec33f539 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.717020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.717676 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.717990 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.718267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.718947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.720822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.745835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1163/2331] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:49.750603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.762973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3f5d0-344e-4c12-979c-ff7309f8ceba None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.816574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.817160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.817439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.817732 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.818432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.820354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.840085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1169/2332] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:49 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:49.844115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.854094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537fa9-746c-4988-b556-3d275011c65e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.859509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.860225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.860609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.860891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.861614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.863261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.874556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1164/2333] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:49.878455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.888882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e29c3-c091-4755-943f-8db788745103 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.893620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.894536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.894821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.895099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] PATH_INFO: `/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600/users/1d975755902f4f5f897f9ed267eee258/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.909330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621bb2ce9fc349a2a2a28ba2a36f0600, user_id=1d975755902f4f5f897f9ed267eee258, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.912025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.925296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1170/2334] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:49 2022] PUT /identity/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600/users/1d975755902f4f5f897f9ed267eee258/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:49.929310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.940345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498c3-31a7-48e9-b058-101599c1dbc9 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.995888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.996604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.996832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.997113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.997872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.999456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209abe-76af-4e4a-a494-f2dfc6a0a0ff admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.013052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1165/2335] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:50.014479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.024861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a52de-c61a-4a61-a3bc-443f6b0861d4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.030680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.031563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.031847 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.032127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] PATH_INFO: `/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600/users/1d975755902f4f5f897f9ed267eee258/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.034113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621bb2ce9fc349a2a2a28ba2a36f0600, user_id=1d975755902f4f5f897f9ed267eee258, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.036748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.049697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1171/2336] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:50 2022] PUT /identity/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600/users/1d975755902f4f5f897f9ed267eee258/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:50.064962 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.065250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.065525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.091157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] MFA Rules not processed for user `1d975755902f4f5f897f9ed267eee258`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:50.092807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.159235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1166/2337] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:50.169417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.171654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.225236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4d5c-31b9-4650-9d2c-33c739e7e080 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.228875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.229511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.229821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.230109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.239329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.240745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.249874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1172/2338] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:50 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:50.317614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.327296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228be2f-a0fb-4e6e-b46f-de1c297a0a28 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.330954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.331592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.331875 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.332154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.384911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.386306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.396303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1167/2339] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:50 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:52.573196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:52.575565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:52.659392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91996b9-94e6-4dcd-8dd3-0d82b85b07ed service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:52.663416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:52.664190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:52.664580 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:52.664972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:52.666981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:52.740320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:52.742283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a124-6da3-423a-b746-97ac75b60134 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:52.756229 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1173/2340] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:52 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:53.077720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.149692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc45a-67c0-48e0-8d9c-1d9e4cbfaf77 service cinder] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:53.154840 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:53.155746 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.156029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.156303 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] PATH_INFO: `/v3/users/c50c7d6c50f4461192ba61ab8ec0a442` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.157499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50c7d6c50f4461192ba61ab8ec0a442)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:53.159463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.208032 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50c7d6c50f4461192ba61ab8ec0a442'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.208973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50c7d6c50f4461192ba61ab8ec0a442'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.209663 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50c7d6c50f4461192ba61ab8ec0a442'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.218515 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50c7d6c50f4461192ba61ab8ec0a442'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.225708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50c7d6c50f4461192ba61ab8ec0a442'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.244442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1168/2341] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:53 2022] DELETE /identity/v3/users/c50c7d6c50f4461192ba61ab8ec0a442 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:53.249196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.250157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.250630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.276170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:53.277477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:53.344068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1174/2342] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:53.353880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.355307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:53.428083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fa40a-5713-46ce-998e-f39508b9483f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:53.432009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:53.432771 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.433162 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.433531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.443662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:53.445161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.461874 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1169/2343] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:53.742083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.743706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:53.757196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d23c4f-9449-4774-85ab-4abef12769ae None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:53.762426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:53.763405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.764113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.764403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] PATH_INFO: `/v3/projects/8e439b082505441682afef1b4b97dd7d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.765717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e439b082505441682afef1b4b97dd7d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:53.767751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.817052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e439b082505441682afef1b4b97dd7d', 'request_id': 'req-28235703-8335-4561-a821-0695e97bb67b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.827162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e439b082505441682afef1b4b97dd7d', 'request_id': 'req-28235703-8335-4561-a821-0695e97bb67b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.833850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e439b082505441682afef1b4b97dd7d', 'request_id': 'req-28235703-8335-4561-a821-0695e97bb67b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.845813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] The token cache is being invalidate because project 8e439b082505441682afef1b4b97dd7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:53.846280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.847019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.848648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1175/2344] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:53 2022] DELETE /identity/v3/projects/8e439b082505441682afef1b4b97dd7d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:53.852679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.863339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215823f1-befa-499b-865f-3703e0716d76 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:53.923358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:53.924567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.924847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.925125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] PATH_INFO: `/v3/users/1d975755902f4f5f897f9ed267eee258` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.926372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d975755902f4f5f897f9ed267eee258)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:53.928307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.981266 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d975755902f4f5f897f9ed267eee258'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.981963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d975755902f4f5f897f9ed267eee258'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.983189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d975755902f4f5f897f9ed267eee258'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.991581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d975755902f4f5f897f9ed267eee258'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.998898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-78f2ca79-8b94-4ac6-8ee8-fc96c1d0e958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d975755902f4f5f897f9ed267eee258'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.018407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1170/2345] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:53 2022] DELETE /identity/v3/users/1d975755902f4f5f897f9ed267eee258 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:54.547163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.548829 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.563198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235703-8335-4561-a821-0695e97bb67b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.624525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.625406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.625695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.626006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] PATH_INFO: `/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.627268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621bb2ce9fc349a2a2a28ba2a36f0600)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.629184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.676671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621bb2ce9fc349a2a2a28ba2a36f0600', 'request_id': 'req-74887dc2-d318-4500-aff3-c87c022bd435'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.684836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621bb2ce9fc349a2a2a28ba2a36f0600', 'request_id': 'req-74887dc2-d318-4500-aff3-c87c022bd435'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.692185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621bb2ce9fc349a2a2a28ba2a36f0600', 'request_id': 'req-74887dc2-d318-4500-aff3-c87c022bd435'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.704433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] The token cache is being invalidate because project 621bb2ce9fc349a2a2a28ba2a36f0600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:54.704774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.705374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-74887dc2-d318-4500-aff3-c87c022bd435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.707680 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1176/2346] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:54 2022] DELETE /identity/v3/projects/621bb2ce9fc349a2a2a28ba2a36f0600 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:54.713299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.713835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.713935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.731407 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:54.732673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.796330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1171/2347] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:54.804472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.805026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.805179 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.824266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:54.825466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.833963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1177/2348] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:54.844018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.854331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389c05-1faf-4796-a2b1-eab9c2318da9 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.859116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.859790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.860078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.860358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.861082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:54.861394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.863038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.874992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1172/2349] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:54.879350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.888101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3513c-d844-4cf4-9eaf-bf8e23d67fa3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.893894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.894572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.895006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.895126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.895832 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.897729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.927988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1178/2350] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:54.932256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.943106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ecbfc-c744-4c96-a5af-c913c4335d2e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.021432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.022404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.022803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.023179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.023975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.026496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.055391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1173/2351] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/users => generated 305 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:55.056616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.070120 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3599-f725-47d1-91c0-e9c79aacae76 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.076514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.077512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.078005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.078355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.079154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.080837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.096208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1179/2352] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:55.097572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.110104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523df68-e81b-4924-94cf-8deb81a4f2d4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.115766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.116593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.116894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.117844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.118231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.121196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e93b7-77b4-4ecc-9fb9-50c9d719632e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.138165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1174/2353] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:55.140215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.151085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ddf9e-315c-4744-9511-00253eded6cb admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.157203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.158448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.158729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.159006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] PATH_INFO: `/v3/projects/f9a0b43d233e4c1eba2cb33b1e6b35eb/users/67ac133daff5413ead0369001a40a468/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.193977 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a0b43d233e4c1eba2cb33b1e6b35eb, user_id=67ac133daff5413ead0369001a40a468, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.198331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.228678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1180/2354] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:55 2022] PUT /identity/v3/projects/f9a0b43d233e4c1eba2cb33b1e6b35eb/users/67ac133daff5413ead0369001a40a468/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:55.233130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.233590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.234063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.280094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] MFA Rules not processed for user `67ac133daff5413ead0369001a40a468`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:55.284466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:55.391939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1175/2355] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:55 2022] POST /identity/v3/auth/tokens => generated 3429 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:55.394005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.504369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26594a4-079f-4559-b21d-b11de6c516b3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.519573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.521221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.521695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.522422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.523406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.526692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.590907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1181/2356] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:55 2022] POST /identity/v3/projects => generated 409 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:55.595443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.613524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d001504-1a4c-43de-9ab9-5b1740bd80ee None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.755760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.756592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.757093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.757520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.758424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.760908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.794022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1176/2357] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:55 2022] POST /identity/v3/users => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:55.797969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.813985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91e08c-be81-42d8-824e-cbebaa0386fa admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.820098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.820609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.820953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.821245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.822003 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.823909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.837061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1182/2358] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:55.841329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.853689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa398f-cbf2-487f-862f-5e22d3485199 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:55.859449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:55.860739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:55.861490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:55.861490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] PATH_INFO: `/v3/projects/b678315eb7d6412abdf06db735556037/users/bd546eaca05a423b8fcff155dc04e746/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:55.884577 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b678315eb7d6412abdf06db735556037, user_id=bd546eaca05a423b8fcff155dc04e746, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:55.887748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:55.909624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1177/2359] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:55 2022] PUT /identity/v3/projects/b678315eb7d6412abdf06db735556037/users/bd546eaca05a423b8fcff155dc04e746/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:55.913810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:55.925535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9b54-b86c-4d6e-a1de-adddd9537f06 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.022252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.022867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.023152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.023433 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.024162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.025965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2f59-11d7-420a-bcaf-61571739e4c4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:56.038611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1183/2360] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:56.042532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:56.066499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5588-6140-4116-a366-92862304a403 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.073999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.076167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.076483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.078004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] PATH_INFO: `/v3/projects/b678315eb7d6412abdf06db735556037/users/bd546eaca05a423b8fcff155dc04e746/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.083234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b678315eb7d6412abdf06db735556037, user_id=bd546eaca05a423b8fcff155dc04e746, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.106659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:56.145526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1178/2361] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:56 2022] PUT /identity/v3/projects/b678315eb7d6412abdf06db735556037/users/bd546eaca05a423b8fcff155dc04e746/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:56.156045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.156565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.157016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.197457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] MFA Rules not processed for user `bd546eaca05a423b8fcff155dc04e746`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:56.198874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:56.331995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1184/2362] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:04:56 2022] POST /identity/v3/auth/tokens => generated 3496 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:56.343350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:56.344904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:56.427734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0a30e-a693-4a42-8ed9-2f90084f8bd3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.431732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.432440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.432727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.432999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.446065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.447546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368e90-9fc2-42c3-b2f3-7dfde27a7803 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:56.458507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1179/2363] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3496 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:56.628347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:56.640624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e199425-0f16-4e2a-a0de-cdf80505453a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.644957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.645635 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.645968 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.646248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.711278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.712739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:56.723129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1185/2364] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:56 2022] GET /identity/v3/auth/tokens => generated 3429 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:57.755513 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:57.756440 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:57.756899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:57.780161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:57.781665 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:57.858115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1180/2365] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:04:57 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:57.879793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:57.883340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:57.998455 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33640-4781-462c-bb70-7d54538bc3a8 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:58.007922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:58.008756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:58.009044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:58.009322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:58.025145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:58.027810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:58.039661 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1186/2366] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:01.001489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.002981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:01.073867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72786f2-2e12-47e1-af73-d737ef77ce7a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.078929 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.079857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.080317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.080596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] PATH_INFO: `/v3/users/a7dc50f676f942319f779d8f141502f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.081824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dc50f676f942319f779d8f141502f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.083757 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.133590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dc50f676f942319f779d8f141502f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.134333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dc50f676f942319f779d8f141502f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.134947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dc50f676f942319f779d8f141502f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.144261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dc50f676f942319f779d8f141502f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.151366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-19b40407-4c9b-4a8e-b7dc-4167af217d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dc50f676f942319f779d8f141502f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.169465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1181/2367] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:00 2022] DELETE /identity/v3/users/a7dc50f676f942319f779d8f141502f4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:01.355227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.366141 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da36c44-c276-44ad-b471-7038ac565bc0 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.423166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.424093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.424378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.424654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] PATH_INFO: `/v3/projects/a830c3a19c3740619ece0b4ca820490e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.425856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a830c3a19c3740619ece0b4ca820490e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.427766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.474267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a830c3a19c3740619ece0b4ca820490e', 'request_id': 'req-afc21571-8b62-476d-b240-971a6541aaf4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.483133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a830c3a19c3740619ece0b4ca820490e', 'request_id': 'req-afc21571-8b62-476d-b240-971a6541aaf4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.489059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a830c3a19c3740619ece0b4ca820490e', 'request_id': 'req-afc21571-8b62-476d-b240-971a6541aaf4'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.500653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] The token cache is being invalidate because project a830c3a19c3740619ece0b4ca820490e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:01.500946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.501596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-afc21571-8b62-476d-b240-971a6541aaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:01.503407 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1187/2368] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:01 2022] DELETE /identity/v3/projects/a830c3a19c3740619ece0b4ca820490e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:01.509137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.509464 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.514703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.528410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:01.530232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:01.591158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1182/2369] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:01.599934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.600222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.600501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.619107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:01.620533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:01.629216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1188/2370] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:01.634014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.644046 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b854f65-3c2e-4090-88f2-8e955162a592 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.648622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.649318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.649603 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.649924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.650648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:01.650957 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.652545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.665702 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1183/2371] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:01.669965 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.679710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f2f6c-cb7c-4450-bc69-4f4523de2fe2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.684497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.685151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.685470 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.685768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.686464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.688378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.720597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1189/2372] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:01 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:01.724498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.734259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504411e-87c7-4f49-99e8-2b3d9833188c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.791863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.792546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.792832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.793108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.793827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.795761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.815726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1184/2373] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:01 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:01.819742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.830397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6a2b-422f-4b4b-b7d8-df7c3d684069 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.835145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.835833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.836138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.836412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.837153 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.838774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.849453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1190/2374] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:01.853579 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.863587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8736-f06a-4577-a4be-50b62f01b8bd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.868154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.868822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.869104 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.869410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.870154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.871741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96b8d-5d91-462c-8414-3e7c7646cfe9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.881350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1185/2375] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:01.885600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:01.896001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568429-6c77-4db4-964c-3d5f53e7f9d0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:01.900881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:01.901778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.902080 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.902360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] PATH_INFO: `/v3/projects/4de8cc059e0548889ab67b12cf5880e3/users/67ba566cab934b43ab17f719b35bea85/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.916860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de8cc059e0548889ab67b12cf5880e3, user_id=67ba566cab934b43ab17f719b35bea85, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:01.919688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:01.931679 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1191/2376] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:01 2022] PUT /identity/v3/projects/4de8cc059e0548889ab67b12cf5880e3/users/67ba566cab934b43ab17f719b35bea85/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:01.944732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:01.945228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:01.946177 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:01.973319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] MFA Rules not processed for user `67ba566cab934b43ab17f719b35bea85`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:01.974563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:02.039227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1186/2377] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:01 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:02.051007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:02.052720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:02.122714 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcee5d2-f623-4cb6-b2dd-5264718ea215 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:02.129114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:02.129790 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:02.130084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:02.130365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:02.138231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:02.140467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d0e2-0e67-47e4-ac79-fd02419a196b service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:02.149028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1192/2378] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:02 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:04.083870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.085295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.147833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6cea2-dc3f-4da3-a1b4-e237c93b5d30 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.152389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.153256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.153538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.153835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] PATH_INFO: `/v3/users/67ac133daff5413ead0369001a40a468` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.155115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ac133daff5413ead0369001a40a468)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.157021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.200611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ac133daff5413ead0369001a40a468'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.201384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ac133daff5413ead0369001a40a468'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.202700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ac133daff5413ead0369001a40a468'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.209602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ac133daff5413ead0369001a40a468'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.216256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ac133daff5413ead0369001a40a468'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.232398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1187/2379] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:04 2022] DELETE /identity/v3/users/67ac133daff5413ead0369001a40a468 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:04.237394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.237935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.238079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.256576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:04.258538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.320065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1193/2380] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:04.330315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.331633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.390222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fc24-b2fe-44cc-bff0-b95097757cfa admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.394955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.395829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.396155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.396442 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.406523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.407954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.417226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1188/2381] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:05:04.673963 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.675373 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.687763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd0c8-72af-497f-a3f2-c85d3277e2ef None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.692728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.693588 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.693916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.694208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] PATH_INFO: `/v3/projects/f9a0b43d233e4c1eba2cb33b1e6b35eb` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.695395 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a0b43d233e4c1eba2cb33b1e6b35eb)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.697308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.743311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a0b43d233e4c1eba2cb33b1e6b35eb', 'request_id': 'req-748fb9b8-f832-4399-9042-43bad50d37a9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.750930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a0b43d233e4c1eba2cb33b1e6b35eb', 'request_id': 'req-748fb9b8-f832-4399-9042-43bad50d37a9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.756093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a0b43d233e4c1eba2cb33b1e6b35eb', 'request_id': 'req-748fb9b8-f832-4399-9042-43bad50d37a9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.766467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] The token cache is being invalidate because project f9a0b43d233e4c1eba2cb33b1e6b35eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:04.766748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.767363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.768860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1194/2382] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:04 2022] DELETE /identity/v3/projects/f9a0b43d233e4c1eba2cb33b1e6b35eb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:04.772750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.782708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91360469-5f0b-4ea1-ad71-3cf1acab52cf service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.836500 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.837360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.837646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.837955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] PATH_INFO: `/v3/users/bd546eaca05a423b8fcff155dc04e746` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.839127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd546eaca05a423b8fcff155dc04e746)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.841029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.884666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd546eaca05a423b8fcff155dc04e746'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.885309 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd546eaca05a423b8fcff155dc04e746'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.885933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd546eaca05a423b8fcff155dc04e746'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.892915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd546eaca05a423b8fcff155dc04e746'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.899361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-0088c0d7-b2b3-4b46-a919-90722b588692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd546eaca05a423b8fcff155dc04e746'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.917905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1189/2383] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:04 2022] DELETE /identity/v3/users/bd546eaca05a423b8fcff155dc04e746 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:05.186549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.187956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:05.206946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fb9b8-f832-4399-9042-43bad50d37a9 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.272258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.273830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.274285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.274760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] PATH_INFO: `/v3/projects/b678315eb7d6412abdf06db735556037` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.276463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b678315eb7d6412abdf06db735556037)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.278515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.323416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b678315eb7d6412abdf06db735556037', 'request_id': 'req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:05.331052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b678315eb7d6412abdf06db735556037', 'request_id': 'req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:05.336342 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b678315eb7d6412abdf06db735556037', 'request_id': 'req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:05.346882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] The token cache is being invalidate because project b678315eb7d6412abdf06db735556037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:05.347204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:05.347794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-261e6da1-0250-44fb-b3d6-f9bffdd6f51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:05.349317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1195/2384] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:05 2022] DELETE /identity/v3/projects/b678315eb7d6412abdf06db735556037 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:05.355024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.355478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.355586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.377495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:05.378652 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:05.435483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1190/2385] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:05.445096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.445387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.445669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.464645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:05.465881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:05.473800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1196/2386] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:05.478042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.487521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af931b-2151-4262-9e6f-549a29f016c8 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.492093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.492751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.493034 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.493312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.494073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:05.494382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.495961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.508283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1191/2387] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:05:05.512606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.522461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9f2c-a883-499f-9fc4-e17a7feed9c4 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.527150 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.527801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.528087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.528365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.529062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.530982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.555686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1197/2388] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:05.559611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.573231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9283-3b5d-4e78-a163-591705fb7c30 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.629380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.630039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.630318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.630592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.631279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.633153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.652714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1192/2389] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:05.656865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.667050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be321ff6-794e-4dc0-89f6-a4a5c1238164 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.672397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.673063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.673346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.673626 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.674375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.675959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.687386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1198/2390] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:05.691463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.701727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4240fb-c4b4-4ab8-80bc-949cd1d1d221 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.706462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.707183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.707394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.707748 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.708556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.710494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099db71-0c46-48aa-91b2-5a3b95d7a71c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.720481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1193/2391] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:05.724784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.735764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f5cb-82a7-4e01-8413-052c5b866f2b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.740422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.741330 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.741638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.741955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] PATH_INFO: `/v3/projects/0dcc9f145607407ab8892a48ae8538a0/users/4a7bc00091eb4788b4090e8a642015b4/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.756737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcc9f145607407ab8892a48ae8538a0, user_id=4a7bc00091eb4788b4090e8a642015b4, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.759421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.773933 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1199/2392] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:05 2022] PUT /identity/v3/projects/0dcc9f145607407ab8892a48ae8538a0/users/4a7bc00091eb4788b4090e8a642015b4/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:05.783853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.784148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.784431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.811912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] MFA Rules not processed for user `4a7bc00091eb4788b4090e8a642015b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:05.813125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:05.875526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1194/2393] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:05.879955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.947467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaee9b4-844a-47a7-8a9c-7b20533cd43f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:05.952133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:05.952786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:05.953069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:05.953345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:05.954076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:05.955961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:05.979331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1200/2394] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:05.983891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:05.994419 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a3a25-2f7f-4cda-9c6a-11025ec03be6 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.048790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.049483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.049778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.050066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.050752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.052660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.072911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1195/2395] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:05 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:06.077379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:06.087491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2536-d7be-480e-be60-65dbd76bc9c5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.093432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.094122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.094413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.094692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.095409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.096999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.106724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1201/2396] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:06.111433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:06.121022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb2900-9204-401a-b070-ff825fedef2a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.126311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.127206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.127473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.127749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] PATH_INFO: `/v3/projects/351fb1ab98584ec28e6894a6947cc0d2/users/506547bdee9c488aa4cf5057340e11f4/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.141864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351fb1ab98584ec28e6894a6947cc0d2, user_id=506547bdee9c488aa4cf5057340e11f4, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.144414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.157102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1196/2397] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:06 2022] PUT /identity/v3/projects/351fb1ab98584ec28e6894a6947cc0d2/users/506547bdee9c488aa4cf5057340e11f4/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:06.161114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:06.171594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2adc0-0303-462a-af51-513a32d2dfbc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.225430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.226134 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.226420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.226696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.227406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.228993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca1e6c-1fc6-4dc8-9db0-0bbbcdbf370b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.238994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1202/2398] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:06.243221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:06.253167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4d0c-452d-4d45-a013-2b67da37fd39 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.258083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.259005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.259294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.259625 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] PATH_INFO: `/v3/projects/351fb1ab98584ec28e6894a6947cc0d2/users/506547bdee9c488aa4cf5057340e11f4/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.261622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=351fb1ab98584ec28e6894a6947cc0d2, user_id=506547bdee9c488aa4cf5057340e11f4, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.264363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.274913 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1197/2399] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:06 2022] PUT /identity/v3/projects/351fb1ab98584ec28e6894a6947cc0d2/users/506547bdee9c488aa4cf5057340e11f4/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:06.285915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.286694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.286694 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.313117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] MFA Rules not processed for user `506547bdee9c488aa4cf5057340e11f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:06.314366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:06.378234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1203/2400] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:06 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:06.388042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:06.390103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:06.444865 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ffed-3114-4c86-a70b-dcd0d899d3ef admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:06.448504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:06.449138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:06.449423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:06.449703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:06.502417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:06.503838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac417-eebc-4570-8186-e520801a7f45 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:06.512430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1198/2401] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:06 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:09.376947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:09.378545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:09.443712 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4f6e-97fd-48f9-a42a-ccb42072acc0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:09.449935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:09.450818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:09.451102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:09.451393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] PATH_INFO: `/v3/users/67ba566cab934b43ab17f719b35bea85` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:09.452570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ba566cab934b43ab17f719b35bea85)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:09.455155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:09.502296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ba566cab934b43ab17f719b35bea85'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:09.502954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ba566cab934b43ab17f719b35bea85'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:09.503603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ba566cab934b43ab17f719b35bea85'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:09.512788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ba566cab934b43ab17f719b35bea85'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:09.520762 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ba566cab934b43ab17f719b35bea85'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:09.542352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1204/2402] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:09 2022] DELETE /identity/v3/users/67ba566cab934b43ab17f719b35bea85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:09.547655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:09.548004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:09.548004 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:09.567999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:09.569205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:09.636760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1199/2403] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:09.647828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:09.649250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:09.706288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0822af-c369-42f5-9e26-43b1a92b0269 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:09.710102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:09.710755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:09.711033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:09.711309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:09.721191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:09.722642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779cd46-4f36-46db-a023-771b29cebf65 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:09.732299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1205/2404] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:09.987447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:09.988856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.002107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a23ddc-1e4a-44a1-b810-bef20545eef1 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.006662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.007539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.007980 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.008418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] PATH_INFO: `/v3/projects/4de8cc059e0548889ab67b12cf5880e3` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.009614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de8cc059e0548889ab67b12cf5880e3)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.011654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.067065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de8cc059e0548889ab67b12cf5880e3', 'request_id': 'req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:10.074052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de8cc059e0548889ab67b12cf5880e3', 'request_id': 'req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:10.080186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de8cc059e0548889ab67b12cf5880e3', 'request_id': 'req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:10.090047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] The token cache is being invalidate because project 4de8cc059e0548889ab67b12cf5880e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:10.090337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:10.090973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-31b2758b-c564-4b4b-b521-75fcbcb5bbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:10.092496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1200/2405] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:09 2022] DELETE /identity/v3/projects/4de8cc059e0548889ab67b12cf5880e3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:10.098427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.098724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.099031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.116590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:10.117866 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.175578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1206/2406] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:10.183397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.183686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.183969 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.202814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:10.204016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.211790 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1201/2407] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:10.215912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.226058 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5ac2f-fb6a-4d8a-82f1-6c34efbdce76 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.231230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.231891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.232295 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.232450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.233177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:10.233481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.235850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.247084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1207/2408] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:10.251286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.260295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ccf6b-1573-4c76-bfac-4bd3af9b4b0e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.265912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.266575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.266855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.267127 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.267820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.269699 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.294835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1202/2409] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:10 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:10.299870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.309842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567eaf4-5676-43b8-b5d2-0e8fe016981a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.365211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.365843 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.366128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.366409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.367107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.369017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.388550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1208/2410] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:10 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:10.392533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.403306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9fc55-7855-45b9-89db-068e1bbdc00a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.408616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.409281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.409565 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.409887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.410607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.412302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.424367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1203/2411] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:10.428467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.439800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963050-7d40-4bf1-8c5b-b4931a3b9cb0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.444751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.445408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.445688 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.445995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.446710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.448285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27779608-0e8b-4a69-939f-81258fbe509a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.458313 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1209/2412] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:10.462465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.472830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf43a-0e5c-4592-a334-b6ce49a6cd7c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.477423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.478347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.478634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.478912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] PATH_INFO: `/v3/projects/178478d5dca34f6a8a4c17c42ab4e6ad/users/e7cb11782a8a4b179d6b93b5d3b02c8f/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.493686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] RBAC: Authorizing `identity:create_grant(project_id=178478d5dca34f6a8a4c17c42ab4e6ad, user_id=e7cb11782a8a4b179d6b93b5d3b02c8f, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.496380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.509528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1204/2413] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:10 2022] PUT /identity/v3/projects/178478d5dca34f6a8a4c17c42ab4e6ad/users/e7cb11782a8a4b179d6b93b5d3b02c8f/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:10.520828 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.521117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.521399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.548531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] MFA Rules not processed for user `e7cb11782a8a4b179d6b93b5d3b02c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:10.549734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.612798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1210/2414] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:10 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:10.623620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.625319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.697122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116f73-f4f5-45a6-958f-cd834527541e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.702616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.703756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.704040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.704309 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.712581 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.714345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.724502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1205/2415] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:10 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:10.725462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:10.726869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.782119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be477c5-850e-4697-bd8d-b2a152b8d316 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:10.785837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:10.786472 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:10.786756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:10.787036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:10.788914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:10.852039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:10.853510 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4428-d6b8-41f3-92d1-756f60ccfd90 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:10.863522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1211/2416] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:10 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:13.577387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:13.682868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c65b83-2322-4290-a3aa-474d72e15bc7 service nova] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:13.689800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:13.689800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:13.690459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:13.690459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] PATH_INFO: `/v3/users/e7cb11782a8a4b179d6b93b5d3b02c8f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:13.691891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cb11782a8a4b179d6b93b5d3b02c8f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:13.694115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:13.764693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cb11782a8a4b179d6b93b5d3b02c8f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:13.766008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cb11782a8a4b179d6b93b5d3b02c8f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:13.766638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cb11782a8a4b179d6b93b5d3b02c8f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:13.774826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cb11782a8a4b179d6b93b5d3b02c8f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:13.783095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cb11782a8a4b179d6b93b5d3b02c8f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:13.800670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1206/2417] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:13 2022] DELETE /identity/v3/users/e7cb11782a8a4b179d6b93b5d3b02c8f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:13.805449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:13.805988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:13.806091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:13.824459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:13.825686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:13.901731 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1212/2418] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:13.915061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:13.916632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:13.984199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4d15-650e-404f-a291-536f84e6ee4f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:13.988509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:13.989220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:13.989532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:13.989995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.005661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.008294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292ec0-aceb-4aec-984d-8c243d8e5cf1 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.020563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1207/2419] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:14.335988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.337522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:14.351980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3a24-0a30-4c49-ae7b-ef9dbc3dabfd None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.362036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.362036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.362036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.362036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] PATH_INFO: `/v3/projects/178478d5dca34f6a8a4c17c42ab4e6ad` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.368243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178478d5dca34f6a8a4c17c42ab4e6ad)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.369234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.426187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178478d5dca34f6a8a4c17c42ab4e6ad', 'request_id': 'req-7dc0ecb7-10f9-462e-8b3c-525d39417766'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:14.445171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178478d5dca34f6a8a4c17c42ab4e6ad', 'request_id': 'req-7dc0ecb7-10f9-462e-8b3c-525d39417766'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:14.452804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178478d5dca34f6a8a4c17c42ab4e6ad', 'request_id': 'req-7dc0ecb7-10f9-462e-8b3c-525d39417766'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:14.463896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] The token cache is being invalidate because project 178478d5dca34f6a8a4c17c42ab4e6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:14.464169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:14.464884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7dc0ecb7-10f9-462e-8b3c-525d39417766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:14.466453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1213/2420] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:14 2022] DELETE /identity/v3/projects/178478d5dca34f6a8a4c17c42ab4e6ad => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:14.473203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.473497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.473815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.492685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:14.493922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:14.555514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1208/2421] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:14.564458 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.564735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.565010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.587394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:14.588619 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:14.596746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1214/2422] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:14.601321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.611474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c59f-c59f-4e79-8448-6999d09e2684 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.616411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.617084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.617367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.617642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.618408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:14.618722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.620317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.633226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1209/2423] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:14.639982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.649468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffacb8-78a7-46f4-bf23-51321ac446f2 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.654888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.655641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.656408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.656681 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.657365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.659294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.685591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1215/2424] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:14 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:14.690461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.700662 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c890-34c2-4ab1-beb4-865bd2b8501f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.769491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.770330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.770619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.770905 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.771641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.773553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.802678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1210/2425] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:14 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:14.808900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.825523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b12e5-ab00-42df-b764-4b44bd91090a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.829806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.830568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.830862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.831164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.831924 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.833565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.846834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1216/2426] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:14.851390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.866452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d123b-dce9-41d9-9958-69f9b76a599a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.876391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.877259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.877812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.878358 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.879439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.881963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a60325-7c57-441e-826f-1b0052c0dd03 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.896809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1211/2427] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:14.901408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:14.912922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a856824-e56b-48cb-b2ab-07dc153ea695 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:14.918975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:14.920005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.920294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.920609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] PATH_INFO: `/v3/projects/9daad5a40624434ba0f4d5253c792cac/users/b4dad35ae8f643b7b0c8329d4893c9f7/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:14.937317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9daad5a40624434ba0f4d5253c792cac, user_id=b4dad35ae8f643b7b0c8329d4893c9f7, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:14.940397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:14.954702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1217/2428] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:14 2022] PUT /identity/v3/projects/9daad5a40624434ba0f4d5253c792cac/users/b4dad35ae8f643b7b0c8329d4893c9f7/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:14.965247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3ab-8629-4996-913c-d068d453280a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:14.965541 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3ab-8629-4996-913c-d068d453280a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:14.965866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3ab-8629-4996-913c-d068d453280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:15.003118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6263b3ab-8629-4996-913c-d068d453280a None None] MFA Rules not processed for user `b4dad35ae8f643b7b0c8329d4893c9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:15.004408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6263b3ab-8629-4996-913c-d068d453280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:15.073227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1212/2429] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:14 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:15.090314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:15.092522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:15.162964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d06fe-dece-414d-93e5-124db532f665 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:15.167045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:15.167722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:15.168051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:15.168328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:15.178292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:15.179718 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14faa5-d579-415c-95f6-ba1765201eea service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:15.191057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1218/2430] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:15 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:15.907154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b3ab-8629-4996-913c-d068d453280a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:15.908632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6263b3ab-8629-4996-913c-d068d453280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:15.982121 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b3ab-8629-4996-913c-d068d453280a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:15.987648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:15.988524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:15.988810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:15.989090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] PATH_INFO: `/v3/users/4a7bc00091eb4788b4090e8a642015b4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:15.990311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7bc00091eb4788b4090e8a642015b4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:15.992234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:16.049029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7bc00091eb4788b4090e8a642015b4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.049738 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7bc00091eb4788b4090e8a642015b4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.050439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7bc00091eb4788b4090e8a642015b4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.061072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7bc00091eb4788b4090e8a642015b4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.069204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7bc00091eb4788b4090e8a642015b4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.086053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1213/2431] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:15 2022] DELETE /identity/v3/users/4a7bc00091eb4788b4090e8a642015b4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:16.090837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:16.091335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:16.091441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:16.108399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:16.110195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:16.176903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1219/2432] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:16.188061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:16.189572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:16.256311 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c3bea-7d72-4796-88ec-da565ea1b3c1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:16.260343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:16.261009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:16.261289 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:16.261556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:16.274460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:16.276520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:16.287366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1214/2433] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:16.587982 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:16.589670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:16.621943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358c9b-d7c4-4a7c-b62f-56ccea745eb1 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:16.621943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:16.623725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:16.623725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:16.624001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] PATH_INFO: `/v3/projects/0dcc9f145607407ab8892a48ae8538a0` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:16.625448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcc9f145607407ab8892a48ae8538a0)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:16.627615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:16.681130 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcc9f145607407ab8892a48ae8538a0', 'request_id': 'req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.691128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcc9f145607407ab8892a48ae8538a0', 'request_id': 'req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.698797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcc9f145607407ab8892a48ae8538a0', 'request_id': 'req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.713247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] The token cache is being invalidate because project 0dcc9f145607407ab8892a48ae8538a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:16.713529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.714216 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.715808 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1220/2434] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:16 2022] DELETE /identity/v3/projects/0dcc9f145607407ab8892a48ae8538a0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:16.721436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:16.732382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822044-12f6-4bb9-86de-b5590f617a95 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:16.814153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:16.815521 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:16.816009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:16.816616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] PATH_INFO: `/v3/users/506547bdee9c488aa4cf5057340e11f4` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:16.820532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506547bdee9c488aa4cf5057340e11f4)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:16.823993 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:16.896113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506547bdee9c488aa4cf5057340e11f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.896976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506547bdee9c488aa4cf5057340e11f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.897692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506547bdee9c488aa4cf5057340e11f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.907638 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506547bdee9c488aa4cf5057340e11f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.917309 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-406365e8-7c46-406b-960f-a12424e12ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506547bdee9c488aa4cf5057340e11f4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:16.938497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1215/2435] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:16 2022] DELETE /identity/v3/users/506547bdee9c488aa4cf5057340e11f4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:17.302526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.304083 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:17.320929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d4a35-9b8e-4c8a-86b4-39d0df6e8f5f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.393462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.394392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.394678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.394955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] PATH_INFO: `/v3/projects/351fb1ab98584ec28e6894a6947cc0d2` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.396182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=351fb1ab98584ec28e6894a6947cc0d2)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.398195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.449786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351fb1ab98584ec28e6894a6947cc0d2', 'request_id': 'req-814f8c21-04ec-440f-8f33-4b5b8ffec67a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:17.458962 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351fb1ab98584ec28e6894a6947cc0d2', 'request_id': 'req-814f8c21-04ec-440f-8f33-4b5b8ffec67a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:17.465078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351fb1ab98584ec28e6894a6947cc0d2', 'request_id': 'req-814f8c21-04ec-440f-8f33-4b5b8ffec67a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:17.481574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] The token cache is being invalidate because project 351fb1ab98584ec28e6894a6947cc0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:17.481913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:17.482567 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-814f8c21-04ec-440f-8f33-4b5b8ffec67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:17.484615 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1221/2436] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:17 2022] DELETE /identity/v3/projects/351fb1ab98584ec28e6894a6947cc0d2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:17.491487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.491777 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.492063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.510186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:17.511420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:17.575891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1216/2437] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:17.586245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.586628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.586911 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.605966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:17.607187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:17.615745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1222/2438] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:17.620052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.630902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf51670-68e2-4c16-bbc9-c92f358cfb0e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.636117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.636970 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.637409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.637804 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.638715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:17.639128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.641296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.653836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1217/2439] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:17.659004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.668546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420037e-252c-465d-a1e6-3f74e58f6f7a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.674413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.675097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.675384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.675665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.676374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.678368 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.708708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1223/2440] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:17 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:17.713359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.727022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1038-f6ff-46c7-a41e-e6995b9595f4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.785476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.786189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.786475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.786753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.787439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.789354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.809685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1218/2441] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:17 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:17.813908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.824879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0376135-d48f-47a3-bb95-bf72af6a38f2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.830788 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.831486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.831772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.832047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.832774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.834412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.847068 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1224/2442] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:17.851328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.861898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa461dda-7a41-47b6-af5d-f2ada6a9c4c4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.866853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.867530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.867818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.868100 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.868835 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.870492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06b614-53dc-4fd0-9d78-c54855a4b5f7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.881037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1219/2443] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:17.885514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:17.896558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73cd3-2efb-4442-ae3f-f8150d1755f3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:17.902333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:17.903416 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.903766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.904147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] PATH_INFO: `/v3/projects/280ff33e399a4e278749818573de11b0/users/632445c843bd4174a1d84b2e996c4024/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.920786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] RBAC: Authorizing `identity:create_grant(project_id=280ff33e399a4e278749818573de11b0, user_id=632445c843bd4174a1d84b2e996c4024, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:17.924139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:17.938753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1225/2444] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:17 2022] PUT /identity/v3/projects/280ff33e399a4e278749818573de11b0/users/632445c843bd4174a1d84b2e996c4024/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:17.950831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:17.951658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:17.951658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:17.981826 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] MFA Rules not processed for user `632445c843bd4174a1d84b2e996c4024`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:17.983071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:18.055084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1220/2445] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:17 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:18.067530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:18.069638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:18.154224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b709a-3f00-4597-80b2-f5e65b0c297c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:18.158699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4799e6d178524148b5aea9a28ddc5145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:18.159301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:18.159589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:18.159867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:18.168760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:18.170387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b10fd-7acd-4b62-a07c-9f1dff2bbe76 service glance] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:18.181242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1226/2446] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:18 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:24.079849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:24.081833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.152855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8e1ef-1bdc-4908-b549-82eefde84f82 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:24.157613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:24.159560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.159560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.159560 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] PATH_INFO: `/v3/users/b4dad35ae8f643b7b0c8329d4893c9f7` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.160785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dad35ae8f643b7b0c8329d4893c9f7)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:24.162899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:24.210062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dad35ae8f643b7b0c8329d4893c9f7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.210651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dad35ae8f643b7b0c8329d4893c9f7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.211261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dad35ae8f643b7b0c8329d4893c9f7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.223399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dad35ae8f643b7b0c8329d4893c9f7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.230408 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dad35ae8f643b7b0c8329d4893c9f7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.249802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1221/2447] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:24 2022] DELETE /identity/v3/users/b4dad35ae8f643b7b0c8329d4893c9f7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:24.254748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.255268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.255442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.274645 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:24.275860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.336630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1227/2448] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:24.348828 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:24.351076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.419774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085b95f-42bf-414a-aa0d-7397aa75a0d5 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:24.424123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:24.424785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.425072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.425345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.435624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:24.437053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfdf18-ff7d-4b8c-8110-b93a9cbc9030 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:24.447884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1222/2449] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:24 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:24.738700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:24.740170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.754839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5a67-aff8-4102-8481-4850670f31fb None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:24.761973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:24.763156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.763486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.763768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] PATH_INFO: `/v3/projects/9daad5a40624434ba0f4d5253c792cac` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.765059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9daad5a40624434ba0f4d5253c792cac)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:24.767929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:24.821291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9daad5a40624434ba0f4d5253c792cac', 'request_id': 'req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.828946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9daad5a40624434ba0f4d5253c792cac', 'request_id': 'req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.836127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9daad5a40624434ba0f4d5253c792cac', 'request_id': 'req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.848030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] The token cache is being invalidate because project 9daad5a40624434ba0f4d5253c792cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:24.848320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.848981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4ef7a7e3-9f62-4291-9a35-c8e7fc869e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:24.850549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1228/2450] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:24 2022] DELETE /identity/v3/projects/9daad5a40624434ba0f4d5253c792cac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:24.856278 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.856567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.856842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.876766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:24.878020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.941649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1223/2451] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:24.950941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:24.951434 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:24.951780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:24.973060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:24.974334 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:24.982970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1229/2452] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:24.987859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:24.998017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3d13-e358-4128-a978-aed10536525f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.003958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.004628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.004914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.005248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.006040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:25.006354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.008050 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.022448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1224/2453] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:25.027133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.036409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b392-31db-4d5c-876d-b021d40fc0f8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.041082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.041768 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.042057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.042332 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.043036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.044957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.074784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1230/2454] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:25.079339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.089241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00624-2c96-49ee-8de8-5c587d93d48c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.153031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.153774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.154070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.154355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.155064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.157868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.183593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1225/2455] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:25.188055 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.199292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191cda9-34e6-4902-b8e0-71e2f0ba3d37 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.204863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.205574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.206064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.206222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.206943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.210042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.225359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1231/2456] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:25.229283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.243668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24663-09eb-46e1-bf1f-316596b119b1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.248530 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.253814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.253814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.253814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.253814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.253814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62672682-347d-4036-8b31-774e67438b6a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.264987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1226/2457] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:25.267667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.279116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea11a0f-24f1-4ef0-9d5e-356b39363fed admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.297199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.298697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.299025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.299807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] PATH_INFO: `/v3/projects/fdcaa90b0bad4c3f83b09178427986f3/users/bb43ad3d82e64e74b120e9b6d6c749ba/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.319975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdcaa90b0bad4c3f83b09178427986f3, user_id=bb43ad3d82e64e74b120e9b6d6c749ba, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.322674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.336152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1232/2458] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:25 2022] PUT /identity/v3/projects/fdcaa90b0bad4c3f83b09178427986f3/users/bb43ad3d82e64e74b120e9b6d6c749ba/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:25.347647 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.347951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.348225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.378751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] MFA Rules not processed for user `bb43ad3d82e64e74b120e9b6d6c749ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:25.380040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:25.456145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1227/2459] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/auth/tokens => generated 3423 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:25.460889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.526109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e143-ab98-4da4-b293-6c23a50f4995 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.531076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.532359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.532636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.532981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.533696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.535611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.561480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1233/2460] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:25.565785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.576567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0ba4b-6042-4829-862b-dd4054ee9d7d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.637326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.638048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.638334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.638655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.639356 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.641741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.669529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1228/2461] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:25.673669 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.684560 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f272c7-22de-4e6a-a80f-322bee6303c1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.691074 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.691748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.692026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.692299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.693022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.694655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.706278 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1234/2462] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:25.710772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.721615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754204f1-d096-4b8b-81d2-e7930b4805d0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.726871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.727797 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.728083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.728364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] PATH_INFO: `/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91/users/f9bd98375b6b43e6908d8b2942ee3739/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.744764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38b41f0c4c24e86b0adb0e3a8b30e91, user_id=f9bd98375b6b43e6908d8b2942ee3739, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.747485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.762247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1229/2463] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:25 2022] PUT /identity/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91/users/f9bd98375b6b43e6908d8b2942ee3739/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:25.766793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.777111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f02bf-c690-4beb-8362-130731730026 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.848784 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.849486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.849882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.850176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.850941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.852630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd158a7-4e04-4e86-a84d-4766fef3ceea admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.863441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1235/2464] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:25.868051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:25.879236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98de4-9652-4d1a-b5f1-0570a85042de admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:25.884185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:25.885083 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.885398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.885677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] PATH_INFO: `/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91/users/f9bd98375b6b43e6908d8b2942ee3739/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.887772 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38b41f0c4c24e86b0adb0e3a8b30e91, user_id=f9bd98375b6b43e6908d8b2942ee3739, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:25.890460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:25.902690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1230/2465] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:25 2022] PUT /identity/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91/users/f9bd98375b6b43e6908d8b2942ee3739/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:25.915390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:25.915676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:25.915954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:25.949442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] MFA Rules not processed for user `f9bd98375b6b43e6908d8b2942ee3739`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:25.950795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:26.028316 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1236/2466] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:25 2022] POST /identity/v3/auth/tokens => generated 3492 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:26.038899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:26.040584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:26.111963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a190-aad9-4b87-8b39-34e94652b38f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:26.116108 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:26.116775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:26.117056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:26.117334 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:26.129294 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:26.130916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29508f4-810d-471c-841f-670b2fb56108 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:26.144146 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1231/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3492 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:26.309683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:26.388428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484b248-59f1-42ff-9103-6230e1186921 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:26.396105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:26.397538 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:26.397980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:26.398267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] PATH_INFO: `/v3/users/bb43ad3d82e64e74b120e9b6d6c749ba` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:26.399943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb43ad3d82e64e74b120e9b6d6c749ba)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:26.402625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:26.470993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb43ad3d82e64e74b120e9b6d6c749ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:26.472013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb43ad3d82e64e74b120e9b6d6c749ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:26.472745 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb43ad3d82e64e74b120e9b6d6c749ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:26.482667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb43ad3d82e64e74b120e9b6d6c749ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:26.491525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb43ad3d82e64e74b120e9b6d6c749ba'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:26.512321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1237/2468] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:26 2022] DELETE /identity/v3/users/bb43ad3d82e64e74b120e9b6d6c749ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:26.522721 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:26.523219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:26.523670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:26.547909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:26.549256 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:26.613892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1232/2469] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:26.625906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:26.627344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:26.692763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497d5a-0d68-4205-9b8a-057c05d57f25 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:26.696637 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:26.697297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:26.697591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:26.697909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:26.710671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:26.711920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:26.723469 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1238/2470] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:27.075902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:27.076675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:27.090456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46ed8b-883a-47c4-8c2e-a394e1685625 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:27.096049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:27.098602 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:27.099040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:27.099459 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] PATH_INFO: `/v3/projects/fdcaa90b0bad4c3f83b09178427986f3` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:27.101208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdcaa90b0bad4c3f83b09178427986f3)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:27.103884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:27.175347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdcaa90b0bad4c3f83b09178427986f3', 'request_id': 'req-217f9fa9-1077-47ca-b0ad-9db735af2bf2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.182807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdcaa90b0bad4c3f83b09178427986f3', 'request_id': 'req-217f9fa9-1077-47ca-b0ad-9db735af2bf2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.189520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdcaa90b0bad4c3f83b09178427986f3', 'request_id': 'req-217f9fa9-1077-47ca-b0ad-9db735af2bf2'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.201733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] The token cache is being invalidate because project fdcaa90b0bad4c3f83b09178427986f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:27.202060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.202739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.204803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1233/2471] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:27 2022] DELETE /identity/v3/projects/fdcaa90b0bad4c3f83b09178427986f3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:27.209913 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:27.220870 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabc2d-1551-4de3-b855-63ac1d0cfaf1 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:27.297667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:27.299094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:27.299379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:27.299748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] PATH_INFO: `/v3/users/f9bd98375b6b43e6908d8b2942ee3739` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:27.301697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9bd98375b6b43e6908d8b2942ee3739)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:27.305015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:27.369597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bd98375b6b43e6908d8b2942ee3739'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.370724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bd98375b6b43e6908d8b2942ee3739'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.371667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bd98375b6b43e6908d8b2942ee3739'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.381897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bd98375b6b43e6908d8b2942ee3739'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.390010 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8c76916d-5d6f-4cf7-a393-88c4e068643d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bd98375b6b43e6908d8b2942ee3739'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.411337 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1239/2472] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:27 2022] DELETE /identity/v3/users/f9bd98375b6b43e6908d8b2942ee3739 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:27.727635 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:27.729095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:27.746456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f9fa9-1077-47ca-b0ad-9db735af2bf2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:27.811658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:27.812534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:27.812861 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:27.813781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] PATH_INFO: `/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:27.815164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38b41f0c4c24e86b0adb0e3a8b30e91)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:27.817332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:27.866882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38b41f0c4c24e86b0adb0e3a8b30e91', 'request_id': 'req-d926bd92-c4b5-4172-8f1b-ea8b125a0616'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.874586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38b41f0c4c24e86b0adb0e3a8b30e91', 'request_id': 'req-d926bd92-c4b5-4172-8f1b-ea8b125a0616'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.883477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38b41f0c4c24e86b0adb0e3a8b30e91', 'request_id': 'req-d926bd92-c4b5-4172-8f1b-ea8b125a0616'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.894068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] The token cache is being invalidate because project b38b41f0c4c24e86b0adb0e3a8b30e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:27.894388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.895055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d926bd92-c4b5-4172-8f1b-ea8b125a0616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:27.896666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1234/2473] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:27 2022] DELETE /identity/v3/projects/b38b41f0c4c24e86b0adb0e3a8b30e91 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:27.902785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:27.902957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:27.903183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:27.921013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:27.922857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:27.986052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1240/2474] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:27.994416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:27.994692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:27.994977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.014678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:28.015898 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:28.026740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1235/2475] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:28.029582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.039766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c4b9-9b64-4aad-af00-dd29219d37c3 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.044478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.045148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.045435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.045716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.046475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:28.046787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.049071 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.066097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1241/2476] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:28.070784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.081207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4734c0-2844-4b76-af25-ded55e7b523c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.085967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.086646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.086917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.087190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.087877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.089795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.124670 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1236/2477] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:28.128956 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.139957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c86d-15cd-48eb-9ff1-b947ea27dc97 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.198541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.199219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.199503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.199782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.200488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.202457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.224520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1242/2478] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:28.228594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.239808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1349d-9a29-43f4-b9c3-2e538e6a2c67 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.244574 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.245252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.245535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.245849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.246575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.248170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.260494 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1237/2479] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:28.264566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.275138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f7f5-8fc0-49b0-b10a-f2def75dcca5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.279953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.280625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.280906 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.281181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.282442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.284111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74a89-2b51-42ee-9dcc-c11ff23dc113 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.295494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1243/2480] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:28.300125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.310880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e75cd-d45a-4c73-b5c0-041b2373c482 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.316972 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.317968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.318260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.318564 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] PATH_INFO: `/v3/projects/f394d96a7e544d9f874f3abc51da1046/users/1474f5a8c89442409d70f5d2eac94aae/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.335123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f394d96a7e544d9f874f3abc51da1046, user_id=1474f5a8c89442409d70f5d2eac94aae, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.338335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.356301 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1238/2481] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:28 2022] PUT /identity/v3/projects/f394d96a7e544d9f874f3abc51da1046/users/1474f5a8c89442409d70f5d2eac94aae/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:28.367140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.367423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.367703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.397495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] MFA Rules not processed for user `1474f5a8c89442409d70f5d2eac94aae`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:28.398776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:28.475035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1244/2482] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:28.479506 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.540596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef05bf-6c12-4006-9cb9-bade619696f1 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.546042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.546769 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.547072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.547359 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.548310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.550107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.582333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1239/2483] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:28.586440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.598378 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691c94-1757-4efd-b5bc-798e3db987e6 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.657355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.658534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.658815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.659091 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.659795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.661858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.694709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1245/2484] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:28.698191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.714590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82021bc0-2572-4c72-a113-320aaaf2f168 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.721918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.722988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.723431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.723863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.725109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.727912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.749468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1240/2485] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:28.750723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.761113 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01248e7-41b6-4c7f-b2a1-84a5ff545fa2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.767232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.768140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.768476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.768756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] PATH_INFO: `/v3/projects/2497b7ed638f4768bf46bf713d63478e/users/b34c8b677c714930b6072b3310ede6ff/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.785727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2497b7ed638f4768bf46bf713d63478e, user_id=b34c8b677c714930b6072b3310ede6ff, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.788159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.802543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1246/2486] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:28 2022] PUT /identity/v3/projects/2497b7ed638f4768bf46bf713d63478e/users/b34c8b677c714930b6072b3310ede6ff/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:28.807073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.823101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5a77-9dce-4530-9d33-5de4ea77aa83 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.898070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.898792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.899078 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.899349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.900065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.901682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a869e-e0bc-471c-b162-94d3ae81eb54 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.912556 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1241/2487] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:28.918423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:28.929825 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc232ff-b6e1-417b-8e37-f09901c2404a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:28.934581 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:28.935475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.935758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.936038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] PATH_INFO: `/v3/projects/2497b7ed638f4768bf46bf713d63478e/users/b34c8b677c714930b6072b3310ede6ff/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.938587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2497b7ed638f4768bf46bf713d63478e, user_id=b34c8b677c714930b6072b3310ede6ff, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:28.941533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:28.953218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1247/2488] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:28 2022] PUT /identity/v3/projects/2497b7ed638f4768bf46bf713d63478e/users/b34c8b677c714930b6072b3310ede6ff/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:28.965920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:28.966291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:28.966573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:28.994304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] MFA Rules not processed for user `b34c8b677c714930b6072b3310ede6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:28.995711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:29.070484 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1242/2489] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:29.082882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:29.084879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:29.145859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b536-96e1-43f0-a049-56290bf562dd admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:29.149595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:29.150284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:29.150569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:29.150850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:29.160380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:29.161955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34648dfe-321f-425d-a049-d546ada4abf1 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:29.171971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1248/2490] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:29 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:29.557094 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:29.623201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5abb-4eb7-42d1-a094-2976a11d6ff7 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:29.629290 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:29.630203 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:29.630483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:29.630756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] PATH_INFO: `/v3/users/1474f5a8c89442409d70f5d2eac94aae` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:29.631945 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1474f5a8c89442409d70f5d2eac94aae)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:29.633899 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:29.681033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1474f5a8c89442409d70f5d2eac94aae'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:29.681801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1474f5a8c89442409d70f5d2eac94aae'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:29.682554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1474f5a8c89442409d70f5d2eac94aae'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:29.691169 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1474f5a8c89442409d70f5d2eac94aae'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:29.698076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1474f5a8c89442409d70f5d2eac94aae'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:29.715690 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1243/2491] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:29 2022] DELETE /identity/v3/users/1474f5a8c89442409d70f5d2eac94aae => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:29.722112 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:29.722722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:29.723060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:29.743142 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:29.744122 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:29.808571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1249/2492] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:29.819391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:29.820628 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:29.883637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b679-1e87-46e4-bf97-1b0feab4214a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:29.887454 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:29.888116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:29.888410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:29.888671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:29.898273 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:29.899719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:29.911801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1244/2493] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:30.249691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:30.252041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:30.266508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21fe4-1bc7-4366-b68e-ab791af5a05d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:30.273054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:30.274241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:30.274630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:30.275014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] PATH_INFO: `/v3/projects/f394d96a7e544d9f874f3abc51da1046` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:30.278022 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f394d96a7e544d9f874f3abc51da1046)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:30.278300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:30.335317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f394d96a7e544d9f874f3abc51da1046', 'request_id': 'req-55b1bc22-3dd6-409e-ac10-513238eb5417'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.345427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f394d96a7e544d9f874f3abc51da1046', 'request_id': 'req-55b1bc22-3dd6-409e-ac10-513238eb5417'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.351267 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f394d96a7e544d9f874f3abc51da1046', 'request_id': 'req-55b1bc22-3dd6-409e-ac10-513238eb5417'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.362905 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] The token cache is being invalidate because project f394d96a7e544d9f874f3abc51da1046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:30.363196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.363853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.365439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1250/2494] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:30 2022] DELETE /identity/v3/projects/f394d96a7e544d9f874f3abc51da1046 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:30.369481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:30.379944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7264d-0c48-46c5-9a35-d3f66e7468a1 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:30.445086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:30.446018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:30.446315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:30.446622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] PATH_INFO: `/v3/users/b34c8b677c714930b6072b3310ede6ff` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:30.447862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34c8b677c714930b6072b3310ede6ff)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:30.449965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:30.511202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34c8b677c714930b6072b3310ede6ff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.515671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34c8b677c714930b6072b3310ede6ff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.516381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34c8b677c714930b6072b3310ede6ff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.525220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34c8b677c714930b6072b3310ede6ff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.533279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4f2da145-3de3-4173-bf05-8e692fe251df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34c8b677c714930b6072b3310ede6ff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.552329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1245/2495] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:30 2022] DELETE /identity/v3/users/b34c8b677c714930b6072b3310ede6ff => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:30.838662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:30.840205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:30.855224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1bc22-3dd6-409e-ac10-513238eb5417 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:30.920636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:30.921412 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:30.921693 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:30.921999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] PATH_INFO: `/v3/projects/2497b7ed638f4768bf46bf713d63478e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:30.923203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2497b7ed638f4768bf46bf713d63478e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:30.925100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:30.977559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2497b7ed638f4768bf46bf713d63478e', 'request_id': 'req-4e73f0f9-b0ea-4f07-a811-d839627b5333'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.985818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2497b7ed638f4768bf46bf713d63478e', 'request_id': 'req-4e73f0f9-b0ea-4f07-a811-d839627b5333'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:30.991358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2497b7ed638f4768bf46bf713d63478e', 'request_id': 'req-4e73f0f9-b0ea-4f07-a811-d839627b5333'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:31.002488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] The token cache is being invalidate because project 2497b7ed638f4768bf46bf713d63478e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:31.002780 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:31.003432 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4e73f0f9-b0ea-4f07-a811-d839627b5333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:31.004969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1251/2496] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:30 2022] DELETE /identity/v3/projects/2497b7ed638f4768bf46bf713d63478e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:31.010838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.011350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.011458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.030615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:31.032414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:31.095851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1246/2497] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:31.104023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.104317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.104611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.123703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:31.124943 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:31.133343 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1252/2498] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:31.137838 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.150730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fb2b8-b162-4861-9091-e760b17d8be0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.156580 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.157815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.158098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.158371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.159095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:31.159401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.161001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.176997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1247/2499] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:31.178052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.188188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6bdd-b6f4-4b30-86b9-01f49416771c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.193687 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.194406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.194692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.194959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.195665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.197570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.232223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1253/2500] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:31 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:31.233432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.246292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea106-8b05-4501-a535-62176c4f1f76 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.309439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.310173 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.310435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.310714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.311406 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.313877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.336848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1248/2501] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:31 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:31.341228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.351738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d0ed4-f274-4079-893c-dcb75f0fe94e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.362890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.363584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.363871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.364149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.364883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.366544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.378095 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1254/2502] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:31.382357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.392991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebca96-a947-4fd3-9cea-ab212e0b0861 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.397637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.398344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.398620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.398892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.399616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.401248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e18c1-e379-41d7-a4f2-0b4db867ab1f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.412784 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1249/2503] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:31.417037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.428437 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2162b70-2357-4de3-b474-b665b7b64781 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.433230 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.434160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.434445 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.434724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] PATH_INFO: `/v3/projects/009ee478a25741e8af925de9c1b80c60/users/30b5fea011e8439586c15b0333aef845/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.455591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009ee478a25741e8af925de9c1b80c60, user_id=30b5fea011e8439586c15b0333aef845, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.458376 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.472558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1255/2504] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:31 2022] PUT /identity/v3/projects/009ee478a25741e8af925de9c1b80c60/users/30b5fea011e8439586c15b0333aef845/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:31.483684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.483968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.484249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.514028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] MFA Rules not processed for user `30b5fea011e8439586c15b0333aef845`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:31.515642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:31.589703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1250/2505] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:31 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:31.599857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:31.601833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:31.663480 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb588d-68e5-4bbe-a141-6af30925b770 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:31.667254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:31.667909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:31.668190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:31.668466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:31.678978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:31.680348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191fba5-c358-4181-8491-da555377d240 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:31.690936 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1256/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:31 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:34.759988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:34.837661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6e2d-a46a-43f5-a576-8b023b4f064e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:34.844509 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:34.846024 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:34.846499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:34.846967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] PATH_INFO: `/v3/users/30b5fea011e8439586c15b0333aef845` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:34.849302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b5fea011e8439586c15b0333aef845)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:34.852766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:34.907182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b5fea011e8439586c15b0333aef845'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:34.907182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b5fea011e8439586c15b0333aef845'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:34.907481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b5fea011e8439586c15b0333aef845'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:34.915222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b5fea011e8439586c15b0333aef845'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:34.923988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b5fea011e8439586c15b0333aef845'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:34.941674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1251/2507] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:34 2022] DELETE /identity/v3/users/30b5fea011e8439586c15b0333aef845 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:34.946254 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:34.946773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:34.946887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:34.979166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:34.980394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:35.051169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1257/2508] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:35.061619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.063251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:35.126859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b89d-0c79-42f4-8bce-0a9d5dbcb174 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.131950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.132673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.132964 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.133244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.143221 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.144724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb6ed-0e40-4232-9e51-da1312cad596 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.155066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1252/2509] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:35 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:35.440111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.441988 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:35.456213 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eda0ed-0f13-4c7c-b4f2-abf6839a5236 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.461156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.462056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.462425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.462689 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] PATH_INFO: `/v3/projects/009ee478a25741e8af925de9c1b80c60` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.465077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=009ee478a25741e8af925de9c1b80c60)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.467243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.520292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009ee478a25741e8af925de9c1b80c60', 'request_id': 'req-488a9f6b-6d31-48c8-b916-766c31adaf8f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:35.530590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009ee478a25741e8af925de9c1b80c60', 'request_id': 'req-488a9f6b-6d31-48c8-b916-766c31adaf8f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:35.538769 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009ee478a25741e8af925de9c1b80c60', 'request_id': 'req-488a9f6b-6d31-48c8-b916-766c31adaf8f'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:35.555620 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] The token cache is being invalidate because project 009ee478a25741e8af925de9c1b80c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:35.556060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:35.557016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-488a9f6b-6d31-48c8-b916-766c31adaf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:35.559070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1258/2510] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:35 2022] DELETE /identity/v3/projects/009ee478a25741e8af925de9c1b80c60 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:35.565997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.566281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.566562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.585547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:35.586782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:35.649366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1253/2511] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:35.658404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.658404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.658737 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.678082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:35.679304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:35.688146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1259/2512] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:35.692714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.704107 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100af3a-f99e-4817-922c-d9d0848217fb None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.709095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.709792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.710082 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.710360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.712214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:35.712214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.713074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.726667 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1254/2513] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:05:35.731172 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.742401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081b9e9-71ca-4445-a94b-04fc1c3afd28 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.747717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.748456 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.748747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.749032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.749789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.752424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.780720 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1260/2514] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:35 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:35.785144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.795422 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6bd0-245c-4abe-92de-a644b1136fab admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.857533 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.859052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.859052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.859473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.860618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.864998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.896073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1255/2515] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:35 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:35.900655 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.913171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea645af-4706-4bdc-844b-19fbd5ad5507 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.918252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.918934 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.919218 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.919494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.920219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.921875 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.934257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1261/2516] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:35.939267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.949592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cea4dd-becf-4342-8faa-5f46e37df09b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.955167 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.955853 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.956138 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.956416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:35.957148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:35.958783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb6503-93cd-4a72-b313-a4ea2c78089e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:35.976049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1256/2517] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:35.980035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:35.991066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef6152-e95f-4369-abb4-1b83c752a87e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:35.996222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:35.998097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:35.998097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:35.998097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] PATH_INFO: `/v3/projects/d88874e13aa04221b933b43cb2350ad2/users/44ac16b6ba0c415da52972cda26bbd2d/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.017056 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88874e13aa04221b933b43cb2350ad2, user_id=44ac16b6ba0c415da52972cda26bbd2d, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:36.020525 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:36.035443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1262/2518] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:35 2022] PUT /identity/v3/projects/d88874e13aa04221b933b43cb2350ad2/users/44ac16b6ba0c415da52972cda26bbd2d/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:36.040250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.040544 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.040824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.059417 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:36.060764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.121626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1257/2519] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:36.133394 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:36.135285 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.152398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:36.153873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.166154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b253c1-1746-4c10-932f-073cd28ec6d2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:36.171631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:36.173101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.173397 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.173766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] PATH_INFO: `/v3/users/632445c843bd4174a1d84b2e996c4024` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.175654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=632445c843bd4174a1d84b2e996c4024)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:36.178927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:36.199119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f2d67-b725-4034-bf07-87b9489d455a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:36.205770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:36.206419 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.206700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.206975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.220190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:36.222139 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e28b-0cc6-492d-ad6e-9c09470ab65c service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:36.236719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1263/2520] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:36.247872 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632445c843bd4174a1d84b2e996c4024'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:36.249741 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632445c843bd4174a1d84b2e996c4024'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:36.251327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632445c843bd4174a1d84b2e996c4024'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:36.274529 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632445c843bd4174a1d84b2e996c4024'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:36.289404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632445c843bd4174a1d84b2e996c4024'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:36.319252 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1258/2521] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:36 2022] DELETE /identity/v3/users/632445c843bd4174a1d84b2e996c4024 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:36.326439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.327257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.327773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.348125 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:36.349168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.434544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1264/2522] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:36.442031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:36.443720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.522048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f70de-d11f-4026-83fb-172ec443bb0b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:36.528058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:36.528855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.529249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.529453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.542308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:36.546193 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acee1c-d6ef-40dd-abea-8ac0a4172148 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:36.564395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1259/2523] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:36.941547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:36.943361 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:36.957475 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d805c-e316-4c90-bb05-ae1779c3b301 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:36.965051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:36.967163 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:36.968084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:36.968402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] PATH_INFO: `/v3/projects/280ff33e399a4e278749818573de11b0` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:36.970772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] RBAC: Authorizing `identity:delete_project(project_id=280ff33e399a4e278749818573de11b0)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:36.974242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.034600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280ff33e399a4e278749818573de11b0', 'request_id': 'req-30cf297f-c779-4dea-91d2-e0679f8f980c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:37.046208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280ff33e399a4e278749818573de11b0', 'request_id': 'req-30cf297f-c779-4dea-91d2-e0679f8f980c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:37.053220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280ff33e399a4e278749818573de11b0', 'request_id': 'req-30cf297f-c779-4dea-91d2-e0679f8f980c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:37.072462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] The token cache is being invalidate because project 280ff33e399a4e278749818573de11b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:37.072765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:37.073506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-30cf297f-c779-4dea-91d2-e0679f8f980c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:37.076297 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1265/2524] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:36 2022] DELETE /identity/v3/projects/280ff33e399a4e278749818573de11b0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:37.083033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.083488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.083568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.116472 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:37.117998 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:37.227029 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1260/2525] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:37.235890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.236424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.236860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.263037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:37.264686 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:37.278523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1266/2526] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:37.283552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.296453 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25703a0c-3e62-485e-90be-4769c5e53a5d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.302955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.303954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.304412 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.306455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.306455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:37.307235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.310010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.332809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1261/2527] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:37.339189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.356146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d4e4-4682-4592-b110-e34882c4e97f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.361546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.362336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.362809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.363193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.363999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.366052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.400854 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1267/2528] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:37.406843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.417727 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febef4c4-c379-40a5-b3b6-4cef91ec372d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.493692 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.494324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.494710 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.495090 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.495912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.497985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.523736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1262/2529] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:37.527716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.541341 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d2ea0-038c-4d0e-bd77-442181332718 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.555207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.555990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.556358 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.556713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.557705 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.559756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.573311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1268/2530] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:37.577587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.590049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69655-80a5-46cb-825e-47d995a6f0aa admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.599042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.600055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.600347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.601095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.603911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.605546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552358e-7f45-42e6-ac96-f968ef5708c4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.618395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1263/2531] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:37.622574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.634603 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc247-85c1-4c26-b0a5-1f3a0881fbda admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.642393 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.643923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.644406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.644682 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] PATH_INFO: `/v3/projects/afcf855758734c4cac0a2dcb5e0a1107/users/abb3974b052f429a8cba5a7f3ee80d53/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.662764 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcf855758734c4cac0a2dcb5e0a1107, user_id=abb3974b052f429a8cba5a7f3ee80d53, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.666212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.682423 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1269/2532] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:37 2022] PUT /identity/v3/projects/afcf855758734c4cac0a2dcb5e0a1107/users/abb3974b052f429a8cba5a7f3ee80d53/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:37.693481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.693805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.694095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.725087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] MFA Rules not processed for user `abb3974b052f429a8cba5a7f3ee80d53`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:37.726552 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:37.809666 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1264/2533] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:37.813446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.913830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff7187-00f3-497d-a43b-9faf12d73545 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:37.919158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:37.920007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:37.920288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:37.920565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:37.922833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:37.924070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:37.958836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1270/2534] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:37.962655 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:37.976601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2690e-364d-4b7c-ab5b-df8586e42c2b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.046796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.048061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.048345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.048650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.049362 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.051586 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.090695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1265/2535] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:37 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:38.094743 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.115658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114da5-0486-4b71-8690-13383b9dfbe4 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.121227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.121972 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.122257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.122536 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.123314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.124959 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.136749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1271/2536] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:38.142012 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.158452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573fdd9-a18c-4b63-9977-1e7eceba0a16 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.165841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.166613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.166912 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.167192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.171392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.174391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1416b-5e8e-4136-a62c-15db80677862 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.197883 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1266/2537] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:38.201157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.212706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b79c7a-6706-4088-9fe0-c0658be322b0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.222076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.223512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.225529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.226486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] PATH_INFO: `/v3/projects/03e5d8aac65940b8bf941e593a043174/users/4f7d9c05f8a942da83538c99941ce46c/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.270561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e5d8aac65940b8bf941e593a043174, user_id=4f7d9c05f8a942da83538c99941ce46c, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.278498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.297590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1272/2538] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:38 2022] PUT /identity/v3/projects/03e5d8aac65940b8bf941e593a043174/users/4f7d9c05f8a942da83538c99941ce46c/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:38.308760 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.309395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.311446 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.355545 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] MFA Rules not processed for user `4f7d9c05f8a942da83538c99941ce46c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:38.356825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:38.479176 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1267/2539] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:38.484102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.588874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e7fc-5eed-45bd-bfaf-c6d9f05b7715 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.595605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.596301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.596591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.596874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.597583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.599801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.637813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1273/2540] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:38 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:38.642089 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.655976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16097bf-efa2-47b8-b5f0-33db95692548 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.739342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.740052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.740339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.740607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.741675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.743306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.771106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1268/2541] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:38 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:38.775181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.785983 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84094d93-43c5-47c0-b544-27f7ae26ec3c admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.790974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.791667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.791985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.792401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.793208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.795425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.808837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1274/2542] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:38.814471 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.829070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4e9a-1179-4186-a26e-c9def8258ce3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.834750 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.835939 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.836227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.836512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] PATH_INFO: `/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2/users/0cf46935ea5c42bcbee7f12297171040/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.857380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdd5a2ba9a48f28ebe250fd97a56b2, user_id=0cf46935ea5c42bcbee7f12297171040, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:38.860531 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:38.878286 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1269/2543] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:38 2022] PUT /identity/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2/users/0cf46935ea5c42bcbee7f12297171040/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:38.884066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:38.896504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c077c7e-0d08-4402-af20-78aebbec414b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:38.995837 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:38.996632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:38.996938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:38.997197 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:38.998045 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:39.003647 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172f24-4f69-415b-8329-5c14148bdb23 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:39.022155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1275/2544] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:39.024493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:39.046171 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf352-52fa-4025-a430-794e316c5131 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:39.054117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:39.055947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:39.056599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:39.057073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] PATH_INFO: `/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2/users/0cf46935ea5c42bcbee7f12297171040/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:39.061155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdd5a2ba9a48f28ebe250fd97a56b2, user_id=0cf46935ea5c42bcbee7f12297171040, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:39.067288 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:39.082102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1270/2545] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:39 2022] PUT /identity/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2/users/0cf46935ea5c42bcbee7f12297171040/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:39.096224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:39.096224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:39.097041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:39.160508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] MFA Rules not processed for user `0cf46935ea5c42bcbee7f12297171040`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:39.163126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:39.281889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1276/2546] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:39 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:39.287113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:39.290921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:39.357473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8d51-ca51-482f-9bb2-26bc4c75dc8b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:39.362892 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:39.363566 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:39.363854 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:39.364144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:39.455178 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:39.456825 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d549d1-48db-4990-9063-0c983993b255 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:39.479807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1271/2547] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:39 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:41.371387 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:41.373696 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:41.391268 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fe274-85b5-4893-beaa-341f3ad6622b None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:41.396961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:41.397779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:41.398323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:41.398890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:41.514704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:41.519766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:41.535294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1277/2548] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:41 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:41.932416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:41.933011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:41.933095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:41.966870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] MFA Rules not processed for user `44ac16b6ba0c415da52972cda26bbd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:41.969931 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:42.071890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.074830 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:42.076842 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1272/2549] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:41 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:42.177496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53daaf5c-7e6f-4b57-a987-dc58b2969a52 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.184602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.185722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.186057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.186344 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.187289 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.189323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.241805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1278/2550] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:42 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:42.245142 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.259958 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ecf7a-35de-40f2-ae7c-9b89befc10cd None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.369951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.384534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.387068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.387474 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.387832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.389055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.391884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.436726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1273/2551] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:42 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:42.441988 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.459350 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802c26c-f28a-463b-a59c-93b5b08828f8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.465627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.466617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.467064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.467416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.468232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.469568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe4922-2bb4-47a6-a86b-6a58d8b8e208 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.470332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.474248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.474930 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.475357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.475631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.485390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1274/2552] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:05:42.489846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.502968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1e0-b825-40f9-931d-a091261c9d2e admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.512712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.513775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.514199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.514536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] PATH_INFO: `/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997/users/dc408e93c07d4c37905a91bcac0cc63a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.535212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0ea1d1b6cf4b139350f6ada98c5997, user_id=dc408e93c07d4c37905a91bcac0cc63a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.538113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.561567 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1275/2553] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:42 2022] PUT /identity/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997/users/dc408e93c07d4c37905a91bcac0cc63a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:42.563345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.569617 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.571851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.598096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1279/2554] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:42 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:42.663768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984b70-296a-44eb-ae53-7e39550d45e2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.671520 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.673594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.673594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.674070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.674989 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.677859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.699918 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1276/2555] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:42.704946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:42.724782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7732-3e8f-4189-9ac8-897c6dc13839 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:42.729885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:42.730964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:42.731320 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:42.731613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] PATH_INFO: `/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997/users/dc408e93c07d4c37905a91bcac0cc63a/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:42.734223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0ea1d1b6cf4b139350f6ada98c5997, user_id=dc408e93c07d4c37905a91bcac0cc63a, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:42.736740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96688d-cdc8-46a8-9833-fad19dbd289d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:42.753252 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1280/2556] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:42 2022] PUT /identity/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997/users/dc408e93c07d4c37905a91bcac0cc63a/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:47.295055 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:47.306349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52aca-03ff-4f8e-afaf-714ca40f193c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:47.383414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:47.384717 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.385002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.385287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] PATH_INFO: `/v3/users/abb3974b052f429a8cba5a7f3ee80d53` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.387208 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb3974b052f429a8cba5a7f3ee80d53)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:47.389018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:47.479463 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb3974b052f429a8cba5a7f3ee80d53'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:47.480342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb3974b052f429a8cba5a7f3ee80d53'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:47.481151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb3974b052f429a8cba5a7f3ee80d53'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:47.494955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb3974b052f429a8cba5a7f3ee80d53'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:47.508869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb3974b052f429a8cba5a7f3ee80d53'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:47.537632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1277/2557] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:47 2022] DELETE /identity/v3/users/abb3974b052f429a8cba5a7f3ee80d53 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:47.540400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543634-82c1-454f-a037-628944e3da03 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.540877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543634-82c1-454f-a037-628944e3da03 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.540979 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543634-82c1-454f-a037-628944e3da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.572300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-0e543634-82c1-454f-a037-628944e3da03 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:47.576193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0e543634-82c1-454f-a037-628944e3da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:47.716029 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1281/2558] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:47.730942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:47.737349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:47.838364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9444a0-5665-411d-a397-ac4fcd2eb201 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:47.842916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:47.844926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.845703 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.846196 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.865941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:47.868496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:47.887936 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1278/2559] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:47.956786 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.957070 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.957354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.980199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] MFA Rules not processed for user `264a23388dc64b269325ae52eb4130de`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:47.981508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:48.063477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1282/2560] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:47 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:48.607396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:48.613443 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:48.644658 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e1c8a-3045-467c-8e64-b9a754d5d064 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:48.651152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:48.654450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:48.655071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:48.657481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] PATH_INFO: `/v3/projects/afcf855758734c4cac0a2dcb5e0a1107` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:48.660626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcf855758734c4cac0a2dcb5e0a1107)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:48.667743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:48.736098 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcf855758734c4cac0a2dcb5e0a1107', 'request_id': 'req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:48.755187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcf855758734c4cac0a2dcb5e0a1107', 'request_id': 'req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:48.768047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcf855758734c4cac0a2dcb5e0a1107', 'request_id': 'req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:48.805137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] The token cache is being invalidate because project afcf855758734c4cac0a2dcb5e0a1107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:48.805514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:48.808387 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:48.810753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1279/2561] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:48 2022] DELETE /identity/v3/projects/afcf855758734c4cac0a2dcb5e0a1107 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:48.814820 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:48.831440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83568-009e-4d62-81ff-865636b7737c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:48.975608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:48.976504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:48.976785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:48.977054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] PATH_INFO: `/v3/users/4f7d9c05f8a942da83538c99941ce46c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:48.978350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7d9c05f8a942da83538c99941ce46c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:48.980319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:49.070857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7d9c05f8a942da83538c99941ce46c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:49.073709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7d9c05f8a942da83538c99941ce46c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:49.074425 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7d9c05f8a942da83538c99941ce46c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:49.090882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7d9c05f8a942da83538c99941ce46c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:49.099388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7d9c05f8a942da83538c99941ce46c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:49.131204 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1283/2562] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:48 2022] DELETE /identity/v3/users/4f7d9c05f8a942da83538c99941ce46c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:49.858423 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:49.863327 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:49.890493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a50df-b5d8-4c4c-9403-2cee224a6cdc admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:49.997977 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:49.999390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:50.001134 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:50.001696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] PATH_INFO: `/v3/projects/03e5d8aac65940b8bf941e593a043174` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:50.004345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e5d8aac65940b8bf941e593a043174)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:50.006800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:50.069174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e5d8aac65940b8bf941e593a043174', 'request_id': 'req-e3889f37-4987-4752-aabc-599cf97eb5ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.081685 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e5d8aac65940b8bf941e593a043174', 'request_id': 'req-e3889f37-4987-4752-aabc-599cf97eb5ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.095274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e5d8aac65940b8bf941e593a043174', 'request_id': 'req-e3889f37-4987-4752-aabc-599cf97eb5ea'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.121481 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] The token cache is being invalidate because project 03e5d8aac65940b8bf941e593a043174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:50.121681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.122279 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-e3889f37-4987-4752-aabc-599cf97eb5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.128627 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1280/2563] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:49 2022] DELETE /identity/v3/projects/03e5d8aac65940b8bf941e593a043174 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:50.129108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:50.131106 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:50.144663 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40b437-429b-473e-89c4-4a5a5e6f411a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:50.177766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:50.178125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:50.178420 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:50.212470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] MFA Rules not processed for user `dc408e93c07d4c37905a91bcac0cc63a`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:50.214014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:50.224170 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:50.225053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:50.225328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:50.225834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] PATH_INFO: `/v3/users/0cf46935ea5c42bcbee7f12297171040` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:50.227492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf46935ea5c42bcbee7f12297171040)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:50.230749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:50.298690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf46935ea5c42bcbee7f12297171040'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.299577 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf46935ea5c42bcbee7f12297171040'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.300243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf46935ea5c42bcbee7f12297171040'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.309335 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf46935ea5c42bcbee7f12297171040'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.318734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf46935ea5c42bcbee7f12297171040'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:50.323395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1281/2564] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:50 2022] POST /identity/v3/auth/tokens => generated 3464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:50.331339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:50.333642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:50.352992 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1284/2565] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:50 2022] DELETE /identity/v3/users/0cf46935ea5c42bcbee7f12297171040 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:50.471449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8382f7-7c11-47bb-878d-86a7f172d361 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:50.618786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:50.620553 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:50.621128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:50.621737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:50.627070 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:50.720418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:50.722704 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e057054-d3e2-4c1a-8754-fbe579b6787f service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:50.735695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1282/2566] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:50 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:05:50.868609 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:50.873678 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:50.970891 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8875841-9023-4661-823f-44dfb4068ff5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:50.976300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:50.977375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:50.977874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:50.978325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] PATH_INFO: `/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:50.979770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbdd5a2ba9a48f28ebe250fd97a56b2)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:50.982399 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.051542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbdd5a2ba9a48f28ebe250fd97a56b2', 'request_id': 'req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:51.070345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbdd5a2ba9a48f28ebe250fd97a56b2', 'request_id': 'req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:51.079283 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbdd5a2ba9a48f28ebe250fd97a56b2', 'request_id': 'req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:51.092446 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] The token cache is being invalidate because project efbdd5a2ba9a48f28ebe250fd97a56b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:51.093124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:51.095299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-ef6393c0-f9a4-4b5c-8007-b1f58d78ae53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:51.105426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1285/2567] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:50 2022] DELETE /identity/v3/projects/efbdd5a2ba9a48f28ebe250fd97a56b2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:51.120360 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.120849 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.120963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.146493 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:51.148153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:51.240456 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1283/2568] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:51.248175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90329df-dc43-485e-b113-8af2189d482f None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.248723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90329df-dc43-485e-b113-8af2189d482f None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.248723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90329df-dc43-485e-b113-8af2189d482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.290292 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a90329df-dc43-485e-b113-8af2189d482f None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:51.291904 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a90329df-dc43-485e-b113-8af2189d482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:51.313366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1286/2569] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:51.317985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.333900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27c41-1f96-4c76-851a-ee3d62cd9e49 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.339354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.340400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.340829 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.341118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.341886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:51.342202 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.344501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.374650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1284/2570] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:05:51.379299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90329df-dc43-485e-b113-8af2189d482f None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.391716 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90329df-dc43-485e-b113-8af2189d482f None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.403048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.403838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.404225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.404613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.405441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.408384 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.451280 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1287/2571] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:51 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:51.455693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.468066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70957453-6b0c-49c8-8d30-798137f02ab4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.551348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.552149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.552441 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.553421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.554234 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.556282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.592487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.599986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1285/2572] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:51 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:51.605896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8c5d-6e88-498b-93b5-eb893da9a606 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.612969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.614772 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.615569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.616103 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.617065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.619195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.643645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.644148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1288/2573] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:51.654476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408e41-fab9-4d05-9836-1301cbdb2013 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.660043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.660917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.661381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.661860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.663527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.665369 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14e4a-ec6b-4dd1-93f0-4ac5004af2fe admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.691975 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1286/2574] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:51.692713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.707918 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14771da-de95-4939-b209-6a2808625456 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:51.712996 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:51.714167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.714457 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.714735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] PATH_INFO: `/v3/projects/e61a0b67f36849ff9bad5649c701bb76/users/e1df066c8b054678acb044180e8c2d38/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.738251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61a0b67f36849ff9bad5649c701bb76, user_id=e1df066c8b054678acb044180e8c2d38, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:51.745234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:51.776805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1289/2575] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:51 2022] PUT /identity/v3/projects/e61a0b67f36849ff9bad5649c701bb76/users/e1df066c8b054678acb044180e8c2d38/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:51.790101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:51.790686 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:51.791128 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:51.836870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] MFA Rules not processed for user `e1df066c8b054678acb044180e8c2d38`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:51.838413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:51.937528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1287/2576] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:05:51 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:51.950096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:51.954877 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:52.043232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec012-a7c1-4b4e-83d2-bae939e62a92 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:52.050853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:52.052251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:52.052622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:52.052976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:52.071821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:52.074306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf37ab-6889-4dda-8598-9f8c040c20b4 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:52.088158 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1290/2577] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:51 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:03.020053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.086810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7b12e-5e1e-415c-ba30-d07d6c845c1e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.091330 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.092210 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.092495 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.092774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] PATH_INFO: `/v3/users/e1df066c8b054678acb044180e8c2d38` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.094730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1df066c8b054678acb044180e8c2d38)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.097043 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.152292 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1df066c8b054678acb044180e8c2d38'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.153080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1df066c8b054678acb044180e8c2d38'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.153720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1df066c8b054678acb044180e8c2d38'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.164902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1df066c8b054678acb044180e8c2d38'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.172657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1df066c8b054678acb044180e8c2d38'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.189995 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1288/2578] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:03 2022] DELETE /identity/v3/users/e1df066c8b054678acb044180e8c2d38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:03.195013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.195505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.195600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.213102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:03.214331 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.283503 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1291/2579] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:03.295228 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.296678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.357684 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75f80-6302-4834-90d1-2a5d5a793d9d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.366233 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.366907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.367195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.367479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.378787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.380231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1eeb4-72c5-4e65-ad73-bf6b4fadd9b2 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.390313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1289/2580] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:03.691250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.692932 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.712951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed35c20-aaf2-4739-8f74-58785d082b84 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.719383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.720284 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.720566 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.720839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] PATH_INFO: `/v3/projects/e61a0b67f36849ff9bad5649c701bb76` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.730804 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61a0b67f36849ff9bad5649c701bb76)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.733853 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.803702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61a0b67f36849ff9bad5649c701bb76', 'request_id': 'req-8b04d303-923a-45fa-9a90-29ace2e437cc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.813352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61a0b67f36849ff9bad5649c701bb76', 'request_id': 'req-8b04d303-923a-45fa-9a90-29ace2e437cc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.819632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61a0b67f36849ff9bad5649c701bb76', 'request_id': 'req-8b04d303-923a-45fa-9a90-29ace2e437cc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.837494 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] The token cache is being invalidate because project e61a0b67f36849ff9bad5649c701bb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:03.837815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.838486 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-8b04d303-923a-45fa-9a90-29ace2e437cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:03.840271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1292/2581] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:03 2022] DELETE /identity/v3/projects/e61a0b67f36849ff9bad5649c701bb76 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:03.848283 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.848796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.849307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.872648 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:03.873902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.934986 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1290/2582] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:03.944899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.945307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.945695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.967350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:03.968673 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.977303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1293/2583] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:03.982401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.995194 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500507-b0b3-4c4d-810f-fe18fd3f0c21 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.001250 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.001955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.002241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.002522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.003248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:04.003588 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.005214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.018184 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1291/2584] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:04.022403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.031657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc2a94-1ec1-46ea-90fb-705849a7c794 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.036544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.037209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.037493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.037800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.038501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.040403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.076697 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1294/2585] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:04.081550 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.092235 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2006f51-33e6-4e31-8665-163fbcacc3da admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.152339 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.153039 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.153391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.153701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.154436 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.157338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.181163 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1292/2586] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:04 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:04.185291 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.195873 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4693f-c18a-4ace-b88c-4abeedba1c59 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.200812 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.201534 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.201861 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.202145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.202882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.204479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.217462 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1295/2587] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:04.222260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.232763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1114f-e1cc-4944-b559-c0e78eb3f1cd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.238011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.238675 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.238955 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.239229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.240006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.241595 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf2037-ad92-4225-b88d-7c930e469bf0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.253981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1293/2588] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:04.255914 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.266521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56363648-b162-4b99-b12d-6eac171c4917 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.271221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.272110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.272389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.272649 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] PATH_INFO: `/v3/projects/2f9f6ec5f21a4775a393a6e55e34b617/users/0ca9e2035efb4434939b300e1fbe6e2b/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.288785 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9f6ec5f21a4775a393a6e55e34b617, user_id=0ca9e2035efb4434939b300e1fbe6e2b, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.291460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.305608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1296/2589] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:04 2022] PUT /identity/v3/projects/2f9f6ec5f21a4775a393a6e55e34b617/users/0ca9e2035efb4434939b300e1fbe6e2b/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:04.311095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f22f3-6c75-437c-a9f3-8905b58b6963 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.311388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f22f3-6c75-437c-a9f3-8905b58b6963 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.311673 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f22f3-6c75-437c-a9f3-8905b58b6963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.330131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9b8f22f3-6c75-437c-a9f3-8905b58b6963 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:04.331120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9b8f22f3-6c75-437c-a9f3-8905b58b6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.389785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1294/2590] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:04.399920 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.401642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.465893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774409bf-d384-4abc-9e1d-3e70ed2fd23f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.470111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.470757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.471038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.471314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.481246 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.482900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.493015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1297/2591] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:05.152922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adaa8-5367-4840-b6cf-79b6eabefb9a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:05.153954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adaa8-5367-4840-b6cf-79b6eabefb9a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:05.158450 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adaa8-5367-4840-b6cf-79b6eabefb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:05.188333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-6b2adaa8-5367-4840-b6cf-79b6eabefb9a None None] MFA Rules not processed for user `0ca9e2035efb4434939b300e1fbe6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:05.189732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6b2adaa8-5367-4840-b6cf-79b6eabefb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:05.259145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1295/2592] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:05 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:05.274881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:05.276310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:05.337540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06df5-056c-4872-ab98-ca15df1a1f09 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:05.341260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:05.342031 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:05.342319 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:05.342598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:05.351390 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:05.352690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4bc81-78ec-41a5-a9af-aaafd2b36d21 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:05.362408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1298/2593] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:05 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:06.767347 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:06.767886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:06.767886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:06.785524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] MFA Rules not processed for user `0ca9e2035efb4434939b300e1fbe6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:06.786764 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:06.793815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1296/2594] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:06 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:09.212114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:09.212114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:09.212627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:09.231223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] MFA Rules not processed for user `44ac16b6ba0c415da52972cda26bbd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:09.232573 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:09.294798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1299/2595] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:09 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:15.915349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:15.925884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1077-4ac3-42ee-8508-0f746f428f3b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:15.929386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:15.930064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:15.930349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:15.930626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:15.932396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:16.002460 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:16.003896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:16.015019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1297/2596] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:15 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:19.554754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:19.567287 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3157b4-d804-402d-b277-a9d44b4b3dce None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:19.572976 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:19.575776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:19.575776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:19.575776 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:19.576616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:19.593380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:19.596076 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:19.611602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1300/2597] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:19 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:26.066548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:26.080810 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8be4-f040-49fb-9c82-1dcec481724f service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:26.085818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:26.086745 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:26.087280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:26.087697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:26.090607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:26.170255 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:26.172302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de540-8ed3-480e-a26c-f2aeb108e1c2 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:26.186237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1298/2598] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:26 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:30.902793 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.904183 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.918940 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93507-47f9-49a7-9cc4-4878dda51a4b service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.928499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.929161 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.929444 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.929722 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.931593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.998533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.000296 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.018454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1301/2599] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:30 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:32.264559 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.265073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.265205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.286257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:32.287922 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:32.344992 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1299/2600] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:32.394516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.396307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:32.473116 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523988f-a718-48e5-a9d4-ddb93e4e937a service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.479372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.479666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.479773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.480057 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.490811 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.493608 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.503454 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1302/2601] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:06:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:40.100378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.102904 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:40.120462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fb454-86c0-4795-a7bd-3159a86f6eb0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.131668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.133059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.133353 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.133641 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] PATH_INFO: `/v3/users/7abe1b4b11304db7965ce3e6d9c56c42` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.135020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abe1b4b11304db7965ce3e6d9c56c42)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.137917 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:40.187965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abe1b4b11304db7965ce3e6d9c56c42'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.188693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abe1b4b11304db7965ce3e6d9c56c42'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.189338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abe1b4b11304db7965ce3e6d9c56c42'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.197535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abe1b4b11304db7965ce3e6d9c56c42'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.205218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abe1b4b11304db7965ce3e6d9c56c42'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.226074 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1300/2602] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:40 2022] DELETE /identity/v3/users/7abe1b4b11304db7965ce3e6d9c56c42 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:40.405309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.418746 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f8a41-6aaa-40fd-a8bc-9d6101fb6c95 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.474845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.476078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.476364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.476638 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] PATH_INFO: `/v3/projects/8f948307a28a46c882d15550cc527d3e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.477912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f948307a28a46c882d15550cc527d3e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.479859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:40.523691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f948307a28a46c882d15550cc527d3e', 'request_id': 'req-e7eb3d87-501c-482a-89b4-541e83fd33b8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.532301 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f948307a28a46c882d15550cc527d3e', 'request_id': 'req-e7eb3d87-501c-482a-89b4-541e83fd33b8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.538570 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f948307a28a46c882d15550cc527d3e', 'request_id': 'req-e7eb3d87-501c-482a-89b4-541e83fd33b8'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.549912 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] The token cache is being invalidate because project 8f948307a28a46c882d15550cc527d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:40.550657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.551146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.553013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1303/2603] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:40 2022] DELETE /identity/v3/projects/8f948307a28a46c882d15550cc527d3e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:40.556985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.558479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:40.572512 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec19466-f67e-459d-89ba-ec3add4bde13 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.626349 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.627144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.627426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.627700 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] PATH_INFO: `/v3/users/4f52c3b1c6e3457da6957a388e6d7dff` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.628864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f52c3b1c6e3457da6957a388e6d7dff)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.631071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:40.681941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f52c3b1c6e3457da6957a388e6d7dff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.682605 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f52c3b1c6e3457da6957a388e6d7dff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.683269 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f52c3b1c6e3457da6957a388e6d7dff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.691063 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f52c3b1c6e3457da6957a388e6d7dff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.698820 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aeefee8a-ad0a-4ab8-bcbb-0150e56bcd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f52c3b1c6e3457da6957a388e6d7dff'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:40.714882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1301/2604] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:40 2022] DELETE /identity/v3/users/4f52c3b1c6e3457da6957a388e6d7dff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:40.885081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.886792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:40.900493 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb3d87-501c-482a-89b4-541e83fd33b8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.958498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.959364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.959648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.959925 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] PATH_INFO: `/v3/projects/f7958af1ab86410ba70c5300b15da9d8` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.961097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7958af1ab86410ba70c5300b15da9d8)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.963069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.008037 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7958af1ab86410ba70c5300b15da9d8', 'request_id': 'req-af737bbd-e3e0-4c9b-8d67-312d96975c3b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:41.016079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7958af1ab86410ba70c5300b15da9d8', 'request_id': 'req-af737bbd-e3e0-4c9b-8d67-312d96975c3b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:41.023005 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7958af1ab86410ba70c5300b15da9d8', 'request_id': 'req-af737bbd-e3e0-4c9b-8d67-312d96975c3b'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:41.035250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] The token cache is being invalidate because project f7958af1ab86410ba70c5300b15da9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:41.035571 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:41.036234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-af737bbd-e3e0-4c9b-8d67-312d96975c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:41.037838 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1304/2605] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:40 2022] DELETE /identity/v3/projects/f7958af1ab86410ba70c5300b15da9d8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:41.043740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.044026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.044306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.063708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:41.065001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:41.127751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1302/2606] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:41.135944 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.136247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.136515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.160233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:41.161521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:41.170941 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1305/2607] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:41.174819 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.186535 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673f47c-62d2-4099-9892-4f580b0515fe None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.192072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.193016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.193296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.193570 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.194338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:41.194645 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.196248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.208756 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1303/2608] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:41.213209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.223713 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87f53c-b98c-4c95-b888-87781f14d536 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.228860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.229541 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.229856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.230133 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.230826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.232755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.265888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1306/2609] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:41.270815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.281158 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ad187-ceb7-4307-a137-20d69c81a3d2 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.336845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.336845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.337088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.337295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.338007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.339914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.360547 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1304/2610] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:41 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:41.364558 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.374703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56993878-f7cb-41f0-abf2-b30a05730c7f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.379884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.380488 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.380773 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.381050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.381789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.383374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.394431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1307/2611] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:41.398668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.408469 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d208-9c10-4356-8128-9893c4763d98 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.413067 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.413723 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.414057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.414314 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.415028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.416614 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5423e8-cbc9-4f40-98f8-8d3449908fcd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.428701 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1305/2612] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:41.432950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.443579 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c76b7-0c1b-4ef1-b3a8-2f1e445971e5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.448117 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.448990 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.449271 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.449544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] PATH_INFO: `/v3/projects/226f951c63d84729beaecf1a55d5a6a8/users/a0b99882e3054e8da1240d6285ff0565/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.464222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226f951c63d84729beaecf1a55d5a6a8, user_id=a0b99882e3054e8da1240d6285ff0565, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.466885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.480585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1308/2613] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:41 2022] PUT /identity/v3/projects/226f951c63d84729beaecf1a55d5a6a8/users/a0b99882e3054e8da1240d6285ff0565/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:41.485932 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbcfc-c864-4ea7-81d4-67b153d2b1c1 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.486231 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbcfc-c864-4ea7-81d4-67b153d2b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.487159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfbcfc-c864-4ea7-81d4-67b153d2b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.504497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-2edfbcfc-c864-4ea7-81d4-67b153d2b1c1 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:41.505712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2edfbcfc-c864-4ea7-81d4-67b153d2b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:41.563161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1306/2614] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:41.573256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:41.575168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:41.631974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc6c2b-7cba-4f3f-a9e6-a58566f64626 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:41.635506 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:41.636152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:41.636438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:41.636739 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:41.646147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:41.647584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:41.656957 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1309/2615] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:45.840942 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:45.841433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:45.841518 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:45.880367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] MFA Rules not processed for user `a0b99882e3054e8da1240d6285ff0565`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:45.881501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:45.946947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1307/2616] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:45 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:45.951495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:45.962082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2a7-12d6-41ab-8737-35fd4a398dc1 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:45.966902 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:45.967563 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:45.967844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:45.968115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:45.968867 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:45.970860 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:45.997402 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1310/2617] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:45 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:46.001597 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:46.012985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b02474-6cea-4887-8cd1-2466707156ee None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:46.068795 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:46.069478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:46.069847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:46.070064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:46.070755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:46.072679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:46.096762 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1308/2618] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:46 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:46.100719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:46.115233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b5d29-58d4-4c8d-8564-95b201048f0a admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:46.120410 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:46.126507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:46.126507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:46.126507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:46.126507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:46.126507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:46.160450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1311/2619] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:06:46.164765 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:46.175502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724d89e-ab3f-41c6-a68e-6a390bf26e08 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:46.182318 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:46.183214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:46.183497 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:46.183778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] PATH_INFO: `/v3/projects/24cf46db714743ec997a11655a5667ed/users/46dc99e50f7d4cc0806c1fa5ac377699/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:46.199832 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cf46db714743ec997a11655a5667ed, user_id=46dc99e50f7d4cc0806c1fa5ac377699, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:46.203395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:46.219822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1309/2620] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:46 2022] PUT /identity/v3/projects/24cf46db714743ec997a11655a5667ed/users/46dc99e50f7d4cc0806c1fa5ac377699/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:46.223644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:46.234367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefdac4-9103-4b44-8845-8df18e86e54f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:46.301505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:46.302329 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:46.302674 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:46.302971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:46.303683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:46.305274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b557-8ef1-455d-a609-ea7b7ce84518 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:46.316405 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1312/2621] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:46.320778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:46.332015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b24820-855d-4091-8ff8-2bff4fc7efd4 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:46.337870 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:46.338743 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:46.339027 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:46.339317 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] PATH_INFO: `/v3/projects/24cf46db714743ec997a11655a5667ed/users/46dc99e50f7d4cc0806c1fa5ac377699/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:46.341591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cf46db714743ec997a11655a5667ed, user_id=46dc99e50f7d4cc0806c1fa5ac377699, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:46.344300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:46.355921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1310/2622] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:46 2022] PUT /identity/v3/projects/24cf46db714743ec997a11655a5667ed/users/46dc99e50f7d4cc0806c1fa5ac377699/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:51.049818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5396-6dea-494c-a960-89aaf9d6546a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:51.050282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5396-6dea-494c-a960-89aaf9d6546a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:51.050699 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5396-6dea-494c-a960-89aaf9d6546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:51.083453 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-57bc5396-6dea-494c-a960-89aaf9d6546a None None] MFA Rules not processed for user `46dc99e50f7d4cc0806c1fa5ac377699`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:51.084758 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-57bc5396-6dea-494c-a960-89aaf9d6546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:51.157841 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1313/2623] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:51 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:51.171132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:51.173351 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:51.277037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a2fc-904f-4718-9c95-3a0519257088 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:51.282657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:51.283348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:51.283631 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:51.283906 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:51.339099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:51.340693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:51.350633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1311/2624] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:51 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:52.612513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7fc0b-a5af-45ac-bf8b-ca460ca4cd51 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:52.613019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7fc0b-a5af-45ac-bf8b-ca460ca4cd51 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:52.613114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7fc0b-a5af-45ac-bf8b-ca460ca4cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:52.631177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-84b7fc0b-a5af-45ac-bf8b-ca460ca4cd51 None None] MFA Rules not processed for user `a0b99882e3054e8da1240d6285ff0565`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:52.632408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-84b7fc0b-a5af-45ac-bf8b-ca460ca4cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:52.639748 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1314/2625] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:06:52 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:02.258819 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.271755 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183780d7-e889-4dab-85f7-5cb36fabf336 service nova] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.277462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.278331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.278613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.278889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.280644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:02.296335 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.296843 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.308205 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1312/2626] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:02 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:13.014648 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:13.015118 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:13.015235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:13.032840 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] MFA Rules not processed for user `0ca9e2035efb4434939b300e1fbe6e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:13.034066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.086821 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1315/2627] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:07:13 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:13.315571 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:13.316971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.371455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bf006-b482-495b-b611-b3c7b7d0c050 service nova] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:13.375254 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:13.375934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:13.376222 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:13.376503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:13.378894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.388120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:13.389538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:13.397542 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1313/2628] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:13.696899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:13.698375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.779980 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbe05-9ef8-413e-aee1-32e00ca919e8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:13.785559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:13.786242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:13.786528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:13.786807 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:13.788593 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.801346 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:13.802969 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:13.813576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1316/2629] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:13 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:14.505732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:14.514261 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d920-fb74-4e8d-9aa5-db012de5f31c service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:14.518466 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:14.519103 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:14.519391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:14.519668 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:14.521394 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:14.530607 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:14.532019 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffad6b1-aec3-458b-b12a-1d1f5ccd4015 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:14.539841 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1314/2630] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:15.637067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.648069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ed88-f5f0-412c-8589-9d141ae22eaf service placement] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.652243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.653101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.653481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.653899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.655981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:15.666035 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.667464 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.676487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1317/2631] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:20.876873 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.877404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.877404 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.894837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:20.896033 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:20.950135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1315/2632] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:07:20 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:20.963408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.964813 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:21.034815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6b561-6b34-4e4d-b634-934393b9091b service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:21.039826 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:21.040473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:21.040754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:21.041026 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:21.048756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:21.050357 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:21.058096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1318/2633] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:22.842911 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.846207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:22.878338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f77256-f236-4476-a27a-864a7fec1a5e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.887054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.888384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.888896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.889391 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.893061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:22.910291 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.912096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf81ed-0843-4a01-88cd-c409d1b1fdcd service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.937730 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1316/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:22 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:33.629144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:33.638595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730e9b-fd78-4263-aacc-8a750b1ee003 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:33.642763 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:33.643347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:33.643628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:33.643900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:33.653397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:33.654851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:33.665053 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1319/2635] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:33 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:42.843232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6a0e-10ba-4443-b1c2-e622834c5543 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:42.843706 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6a0e-10ba-4443-b1c2-e622834c5543 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:42.843803 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6a0e-10ba-4443-b1c2-e622834c5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:42.862976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ab9f6a0e-10ba-4443-b1c2-e622834c5543 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:42.864187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ab9f6a0e-10ba-4443-b1c2-e622834c5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:42.871175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1317/2636] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:07:42 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:42.892547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:42.903532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d51e0f-e26c-4ffc-b898-8cfeb8bd8665 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:42.909062 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:42.909690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:42.910004 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:42.910282 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:42.918044 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:42.919611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:42.928961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1320/2637] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:07:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:05.045306 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.045925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.045925 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.063781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:05.065510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.072940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1318/2638] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:08:05 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:05.086077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:05.097973 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325f85-a115-4cb4-8496-9a88e749eb75 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:05.103942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:05.104596 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.104923 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.105205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.114478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:05.116081 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:05.125155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1321/2639] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:23.012617 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.014060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:23.077240 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2cfb9-0b86-4923-83d8-4cfc33651cc2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.082093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.082949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.083229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.083502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] PATH_INFO: `/v3/users/0ca9e2035efb4434939b300e1fbe6e2b` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.084669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca9e2035efb4434939b300e1fbe6e2b)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.086792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.131522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca9e2035efb4434939b300e1fbe6e2b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.132180 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca9e2035efb4434939b300e1fbe6e2b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.132812 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca9e2035efb4434939b300e1fbe6e2b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.139467 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca9e2035efb4434939b300e1fbe6e2b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.146613 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-56339c89-f2cf-43f3-b1e2-4d82e932f6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca9e2035efb4434939b300e1fbe6e2b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.163384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1319/2640] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:23 2022] DELETE /identity/v3/users/0ca9e2035efb4434939b300e1fbe6e2b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:23.334007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.347109 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368aeaf-b42b-4460-abfd-de09c2a07613 service swift] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.401585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.402498 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.402775 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.403049 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] PATH_INFO: `/v3/projects/2f9f6ec5f21a4775a393a6e55e34b617` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.404239 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9f6ec5f21a4775a393a6e55e34b617)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.406304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.450241 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9f6ec5f21a4775a393a6e55e34b617', 'request_id': 'req-7ffd2939-9231-4567-a412-9b4cf6076999'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.458043 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9f6ec5f21a4775a393a6e55e34b617', 'request_id': 'req-7ffd2939-9231-4567-a412-9b4cf6076999'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.463209 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9f6ec5f21a4775a393a6e55e34b617', 'request_id': 'req-7ffd2939-9231-4567-a412-9b4cf6076999'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.473421 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] The token cache is being invalidate because project 2f9f6ec5f21a4775a393a6e55e34b617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:23.473706 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.474366 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:23.475849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1322/2641] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:23 2022] DELETE /identity/v3/projects/2f9f6ec5f21a4775a393a6e55e34b617 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:41.402788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:41.403275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:41.403382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:41.419837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] MFA Rules not processed for user `44ac16b6ba0c415da52972cda26bbd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:41.421035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:41.475151 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1320/2642] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:08:41 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:53.262586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:53.264000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:53.331237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd2939-9231-4567-a412-9b4cf6076999 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:53.336085 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:53.336734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:53.337014 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:53.337439 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:53.339245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:53.403227 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:53.404591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:53.414549 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1323/2643] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:56.469152 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:56.470622 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:56.486062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a20af5-24ce-4db8-9c8c-11f2c68a9384 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:56.490626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:56.491502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:56.491788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:56.492086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] PATH_INFO: `/v3/users/264a23388dc64b269325ae52eb4130de` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:56.493455 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264a23388dc64b269325ae52eb4130de)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:56.495451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:56.544862 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264a23388dc64b269325ae52eb4130de'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.545735 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264a23388dc64b269325ae52eb4130de'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.546705 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264a23388dc64b269325ae52eb4130de'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.556045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264a23388dc64b269325ae52eb4130de'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.563778 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a7131b3f-dcf9-4647-9f55-58690a2e6be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264a23388dc64b269325ae52eb4130de'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.582112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1321/2644] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:56 2022] DELETE /identity/v3/users/264a23388dc64b269325ae52eb4130de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:56.746516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:56.758189 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7441f-42c0-46da-8e3b-742a023f9e29 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:56.810954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:56.811801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:56.812084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:56.812363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] PATH_INFO: `/v3/projects/578fc5bd64da4dcdbff2e317361168ec` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:56.813515 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] RBAC: Authorizing `identity:delete_project(project_id=578fc5bd64da4dcdbff2e317361168ec)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:56.815521 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:56.858966 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578fc5bd64da4dcdbff2e317361168ec', 'request_id': 'req-aa89e44a-f2dd-48cd-9208-81160ca7260c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.867002 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578fc5bd64da4dcdbff2e317361168ec', 'request_id': 'req-aa89e44a-f2dd-48cd-9208-81160ca7260c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.872182 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578fc5bd64da4dcdbff2e317361168ec', 'request_id': 'req-aa89e44a-f2dd-48cd-9208-81160ca7260c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.883191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] The token cache is being invalidate because project 578fc5bd64da4dcdbff2e317361168ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:56.883426 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.884038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-aa89e44a-f2dd-48cd-9208-81160ca7260c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:56.885531 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1324/2645] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:56 2022] DELETE /identity/v3/projects/578fc5bd64da4dcdbff2e317361168ec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:56.891430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:56.891722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:56.892007 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:56.908807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:56.910040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:56.965869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1322/2646] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:08:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:56.974349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:56.974658 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:56.974937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:56.993235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:56.994450 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:57.002090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1325/2647] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:08:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:57.006075 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.015914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c57f-fa05-4ac7-8b93-2ccc4e6b18a9 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.020532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.021186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.021470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.021774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.022491 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:57.022830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.024409 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.035424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1323/2648] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:57.040201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.050013 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90b780-7d1f-4dfd-a178-46f2a04cb6cc None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.055557 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.056221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.056514 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.056797 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.057499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.059461 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.093961 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1326/2649] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:57 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:57.099096 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.108802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97048-340e-489d-9dda-6851644c8316 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.163015 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.163759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.164048 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.164361 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.165076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.167049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.189999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1324/2650] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:57 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:57.191217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.201915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21ded1-2b69-4cdf-aabc-b94c806dac43 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.207015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.207673 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.208012 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.208391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.209144 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.210738 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.220929 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1327/2651] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:57.225398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.236008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add29b4-9ae4-402a-a787-192481acd13f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.241649 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.242376 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.242786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.243071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.243796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.245401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b4310-4797-4312-a51a-3d16d167af2b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.257817 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1325/2652] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:57.260360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.271078 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583a98-2d11-4c25-9b17-71826d691bc8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.277217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.278846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.279526 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.280223 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] PATH_INFO: `/v3/projects/ad1d1897a9674c6bbcd0e4d1bd0b55ab/users/c9d0c28025a44aa3a9f5cfca4d91070c/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.298371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1d1897a9674c6bbcd0e4d1bd0b55ab, user_id=c9d0c28025a44aa3a9f5cfca4d91070c, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.301159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.316522 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1328/2653] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:57 2022] PUT /identity/v3/projects/ad1d1897a9674c6bbcd0e4d1bd0b55ab/users/c9d0c28025a44aa3a9f5cfca4d91070c/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:57.322587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8c5c-500d-49ae-815e-a6e8931f176d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.323023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8c5c-500d-49ae-815e-a6e8931f176d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.323426 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8c5c-500d-49ae-815e-a6e8931f176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.341432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c94c8c5c-500d-49ae-815e-a6e8931f176d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:57.342664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c94c8c5c-500d-49ae-815e-a6e8931f176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:57.400175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1326/2654] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:08:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:57.410176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:57.411846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:57.472145 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442680b9-e1e3-483b-bb6f-3dd0e69633f2 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:57.476290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:57.476955 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:57.477234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:57.477507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:57.487318 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:57.488766 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:57.499232 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1329/2655] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:02.588132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678269-81a1-4794-aae1-4185e40bd6e6 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:02.588671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678269-81a1-4794-aae1-4185e40bd6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:02.588671 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678269-81a1-4794-aae1-4185e40bd6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:02.616522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-29678269-81a1-4794-aae1-4185e40bd6e6 None None] MFA Rules not processed for user `c9d0c28025a44aa3a9f5cfca4d91070c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:02.617773 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-29678269-81a1-4794-aae1-4185e40bd6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:02.685626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1327/2656] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:09:02 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:02.699088 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:02.700530 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:02.776099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cf21-084e-4b55-b3a6-c0687aa9202c service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:02.781741 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:02.782442 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:02.782723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:02.782999 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:02.792258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:02.793981 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:02.803882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1330/2657] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:02 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:04.398943 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:04.399788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:04.399788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:04.419763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] MFA Rules not processed for user `c9d0c28025a44aa3a9f5cfca4d91070c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:04.420976 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:04.428884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1328/2658] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:09:04 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:17.003781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:17.015532 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05dd28-9c9b-4d55-9a40-24cbf14f8a49 service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:17.021692 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:17.022411 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:17.022698 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:17.022978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:17.025388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:17.039863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:17.041468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148b92f-110b-410d-a20e-6715a4080858 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:17.052893 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1331/2659] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:17 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:09:22.636322 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:22.638059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:22.709644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf12c0-0f42-46a0-86e4-783e98c1736b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:22.714845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:22.715504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:22.715789 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:22.716069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:22.717846 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:22.729328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:22.730928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a7ee4-9ee9-4a2b-96ad-d7c9534e07b0 service placement] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:22.740660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1329/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:22 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:59.752565 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:59.753208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:59.753208 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] PATH_INFO: `/` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:59.755516 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1332/2661] 10.222.0.77 () {54 vars in 921 bytes} [Fri Jan 28 02:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:09:59.762001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9dcb6-c305-4082-8c03-fa010d112923 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:59.762524 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9dcb6-c305-4082-8c03-fa010d112923 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:59.762643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9dcb6-c305-4082-8c03-fa010d112923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:59.781554 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-31b9dcb6-c305-4082-8c03-fa010d112923 None None] MFA Rules not processed for user `c507723bf8bc4a6aaf7adba0ef25f962`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:59.782630 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-31b9dcb6-c305-4082-8c03-fa010d112923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:59.791331 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1330/2662] 10.222.0.77 () {58 vars in 1018 bytes} [Fri Jan 28 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:59.806994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:59.809568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:59.831155 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baef79-b7a7-4732-9ad3-0c8827787a40 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:59.836858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:59.838097 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:59.838907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:59.838907 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:59.852256 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:59.855333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:59.871369 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1333/2663] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:38.502480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:38.503054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:38.503054 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:38.520324 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] MFA Rules not processed for user `44ac16b6ba0c415da52972cda26bbd2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:38.521539 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:38.575508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1331/2664] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:10:38 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:49.749304 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:49.766949 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b2211-94a4-4d3e-8ed4-29e120144cf6 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:49.770789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:49.771435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.771726 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.772059 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.774025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:49.785016 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:49.786485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.795703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1334/2665] 10.222.0.77 () {60 vars in 1396 bytes} [Fri Jan 28 02:10:49 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3399 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:16.700319 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.709934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7538c-72ad-4701-a4f9-19e55aa0786a None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.713669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.714452 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.714734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.715009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.716737 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.730282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.731707 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.743230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1332/2666] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:20.213882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.222324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c351b-e767-4594-b9a2-30a1c39fa83f service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.225954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.226599 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.226882 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.227157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.228871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:20.241723 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.243168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.254067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1335/2667] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:20 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:43.392824 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.401903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c228fc-c230-4038-b1d7-e8806494de0d service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.405465 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.406148 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.406435 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.406715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.408411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:43.420130 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.421575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.430963 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1333/2668] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:49.977101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:49.979168 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:49.994993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98225b-3c7e-4ed1-8633-9e5715439ce8 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:50.000099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:50.001015 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:50.001299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:50.001576 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] PATH_INFO: `/v3/users/a0b99882e3054e8da1240d6285ff0565` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:50.002857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b99882e3054e8da1240d6285ff0565)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:50.004862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:50.054806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b99882e3054e8da1240d6285ff0565'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.055447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b99882e3054e8da1240d6285ff0565'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.056625 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b99882e3054e8da1240d6285ff0565'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.063795 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b99882e3054e8da1240d6285ff0565'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.070628 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b99882e3054e8da1240d6285ff0565'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.087876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1336/2669] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:49 2022] DELETE /identity/v3/users/a0b99882e3054e8da1240d6285ff0565 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:50.250122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:50.262116 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beab4d-cd34-4002-a91c-4deaf8d2bfd4 service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:50.320333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:50.321192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:50.322168 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:50.322449 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] PATH_INFO: `/v3/projects/226f951c63d84729beaecf1a55d5a6a8` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:50.323619 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] RBAC: Authorizing `identity:delete_project(project_id=226f951c63d84729beaecf1a55d5a6a8)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:50.325528 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:50.369674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226f951c63d84729beaecf1a55d5a6a8', 'request_id': 'req-06e10d75-41c1-4a61-ab15-86d60c67536a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.377827 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226f951c63d84729beaecf1a55d5a6a8', 'request_id': 'req-06e10d75-41c1-4a61-ab15-86d60c67536a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.384871 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226f951c63d84729beaecf1a55d5a6a8', 'request_id': 'req-06e10d75-41c1-4a61-ab15-86d60c67536a'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.394639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] The token cache is being invalidate because project 226f951c63d84729beaecf1a55d5a6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:50.394926 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.395548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.397057 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1334/2670] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:50 2022] DELETE /identity/v3/projects/226f951c63d84729beaecf1a55d5a6a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:50.401225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:50.402667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:50.415765 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18dddb-2f5b-4c6f-945c-9f96223db3e0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:50.470024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:50.470806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:50.471087 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:50.471362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] PATH_INFO: `/v3/users/46dc99e50f7d4cc0806c1fa5ac377699` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:50.472512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dc99e50f7d4cc0806c1fa5ac377699)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:50.474473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:50.517219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dc99e50f7d4cc0806c1fa5ac377699'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.517889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dc99e50f7d4cc0806c1fa5ac377699'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.518490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dc99e50f7d4cc0806c1fa5ac377699'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.525492 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dc99e50f7d4cc0806c1fa5ac377699'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.532231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dc99e50f7d4cc0806c1fa5ac377699'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.549047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1337/2671] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:50 2022] DELETE /identity/v3/users/46dc99e50f7d4cc0806c1fa5ac377699 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:50.724877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:50.726424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:50.741161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10d75-41c1-4a61-ab15-86d60c67536a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:50.798247 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:50.799106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:50.799384 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:50.799654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] PATH_INFO: `/v3/projects/24cf46db714743ec997a11655a5667ed` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:50.800819 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cf46db714743ec997a11655a5667ed)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:50.802751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:50.846345 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cf46db714743ec997a11655a5667ed', 'request_id': 'req-882c9ba9-e31d-4123-948a-3804a4f451b0'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.853719 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cf46db714743ec997a11655a5667ed', 'request_id': 'req-882c9ba9-e31d-4123-948a-3804a4f451b0'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.859644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cf46db714743ec997a11655a5667ed', 'request_id': 'req-882c9ba9-e31d-4123-948a-3804a4f451b0'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.869302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] The token cache is being invalidate because project 24cf46db714743ec997a11655a5667ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:50.869590 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.870244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-882c9ba9-e31d-4123-948a-3804a4f451b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:50.871751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1335/2672] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:50 2022] DELETE /identity/v3/projects/24cf46db714743ec997a11655a5667ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:03.676589 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:03.678294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:03.772606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539663c-6395-4e88-953a-ee1bc070702f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:03.851146 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:03.851833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:03.852123 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:03.852397 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:03.854520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:03.868631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:03.870889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:03.882903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1338/2673] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:12:03 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:12:07.535118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:07.535642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:07.535761 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:07.553594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] MFA Rules not processed for user `c9d0c28025a44aa3a9f5cfca4d91070c`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:12:07.554844 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:07.610470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1336/2674] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:12:16.635725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:16.639365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:16.698517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f999c2-94e7-4567-b1e2-be6ec73a6697 service nova] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:16.702598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:16.703258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:16.703562 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:16.703844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:16.705598 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:16.716270 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:16.717468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:16.725778 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1339/2675] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:12:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:12:37.062909 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:37.064298 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:37.076651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dec8d-9f3d-4c17-879d-4934b925452b None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:37.080431 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:37.081099 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:37.081379 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:37.081654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:37.083348 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:37.144038 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:37.145458 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:37.155508 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1337/2676] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:12:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:12:43.750885 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:43.752884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:43.774749 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d10e-6359-4ccd-a014-ea3e73a88b08 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:43.781098 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:43.782386 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:43.782783 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:43.783181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] PATH_INFO: `/v3/users/44ac16b6ba0c415da52972cda26bbd2d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:43.784833 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ac16b6ba0c415da52972cda26bbd2d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:43.788111 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:43.840561 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ac16b6ba0c415da52972cda26bbd2d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:43.841212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ac16b6ba0c415da52972cda26bbd2d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:43.841834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ac16b6ba0c415da52972cda26bbd2d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:43.848595 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ac16b6ba0c415da52972cda26bbd2d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:43.855644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ac16b6ba0c415da52972cda26bbd2d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:43.872383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1340/2677] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:12:43 2022] DELETE /identity/v3/users/44ac16b6ba0c415da52972cda26bbd2d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:44.039251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:44.051781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94c46-5c40-4472-bfc5-9db9ad003cea service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:44.112333 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:44.113216 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:44.113498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:44.113796 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] PATH_INFO: `/v3/projects/d88874e13aa04221b933b43cb2350ad2` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:44.115023 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88874e13aa04221b933b43cb2350ad2)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:44.116934 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:44.163575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88874e13aa04221b933b43cb2350ad2', 'request_id': 'req-dc4e2afb-b05d-4542-8dcc-73b294310c5b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.171732 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88874e13aa04221b933b43cb2350ad2', 'request_id': 'req-dc4e2afb-b05d-4542-8dcc-73b294310c5b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.178722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88874e13aa04221b933b43cb2350ad2', 'request_id': 'req-dc4e2afb-b05d-4542-8dcc-73b294310c5b'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.190313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] The token cache is being invalidate because project d88874e13aa04221b933b43cb2350ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:12:44.190600 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.191274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.192901 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1338/2678] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:12:44 2022] DELETE /identity/v3/projects/d88874e13aa04221b933b43cb2350ad2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:44.196754 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:44.198307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:44.211505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ae869-e2e1-4796-b5ca-6308b3a3a188 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:44.266993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:44.267876 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:44.268159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:44.268441 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] PATH_INFO: `/v3/users/dc408e93c07d4c37905a91bcac0cc63a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:44.269676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc408e93c07d4c37905a91bcac0cc63a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:44.271667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:44.316818 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc408e93c07d4c37905a91bcac0cc63a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.317444 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc408e93c07d4c37905a91bcac0cc63a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.318061 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc408e93c07d4c37905a91bcac0cc63a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.325389 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc408e93c07d4c37905a91bcac0cc63a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.332690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc408e93c07d4c37905a91bcac0cc63a'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.349306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1341/2679] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:12:44 2022] DELETE /identity/v3/users/dc408e93c07d4c37905a91bcac0cc63a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:44.523800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:44.525633 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:44.539434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2afb-b05d-4542-8dcc-73b294310c5b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:44.596763 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:44.597792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:44.598097 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:44.598375 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] PATH_INFO: `/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:44.599593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0ea1d1b6cf4b139350f6ada98c5997)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:44.601505 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:44.650187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0ea1d1b6cf4b139350f6ada98c5997', 'request_id': 'req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.660137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0ea1d1b6cf4b139350f6ada98c5997', 'request_id': 'req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.667860 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0ea1d1b6cf4b139350f6ada98c5997', 'request_id': 'req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.680299 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] The token cache is being invalidate because project 6a0ea1d1b6cf4b139350f6ada98c5997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:12:44.680687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.681243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:44.683507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1339/2680] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:12:44 2022] DELETE /identity/v3/projects/6a0ea1d1b6cf4b139350f6ada98c5997 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:32.005872 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.008479 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:32.028736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088635-a939-4c1c-9a91-e837d28256cc admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.089212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.090164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.090452 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.090728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] PATH_INFO: `/v3/users/c9d0c28025a44aa3a9f5cfca4d91070c` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.091971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d0c28025a44aa3a9f5cfca4d91070c)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.094030 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.144835 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d0c28025a44aa3a9f5cfca4d91070c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.145477 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d0c28025a44aa3a9f5cfca4d91070c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.146094 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d0c28025a44aa3a9f5cfca4d91070c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.154048 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d0c28025a44aa3a9f5cfca4d91070c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.161481 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-5b8c4617-4bc2-448a-81f4-43bca19ac2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d0c28025a44aa3a9f5cfca4d91070c'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.178243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1342/2681] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:32 2022] DELETE /identity/v3/users/c9d0c28025a44aa3a9f5cfca4d91070c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:32.359787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.361293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:32.374831 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d40-1a9a-4f1b-bb5e-00550bdd85e3 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.432779 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.433643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.433956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.434251 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] PATH_INFO: `/v3/projects/ad1d1897a9674c6bbcd0e4d1bd0b55ab` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.435430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1d1897a9674c6bbcd0e4d1bd0b55ab)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.437336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.483887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'request_id': 'req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.491161 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'request_id': 'req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.497457 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1d1897a9674c6bbcd0e4d1bd0b55ab', 'request_id': 'req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.507950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] The token cache is being invalidate because project ad1d1897a9674c6bbcd0e4d1bd0b55ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:32.508237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.508890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-a69fc50d-6ffb-45a7-95e6-2d9f8a441614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:32.510470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1340/2682] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:32 2022] DELETE /identity/v3/projects/ad1d1897a9674c6bbcd0e4d1bd0b55ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:32.516630 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.516915 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.517195 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.536315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:32.537420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:32.598212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1343/2683] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:32.606609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.606903 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.607189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.625424 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:32.626674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:32.638378 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1341/2684] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:32.642855 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.653073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcded194-a147-481e-9654-8df12c4823a7 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.657736 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.658451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.658729 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.659001 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.659717 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:32.660025 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.661611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.673110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1344/2685] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:13:32.677532 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.687022 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a12eb-4787-4bee-86eb-b3ea06df6af2 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.691682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.692346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.692634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.692916 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.693606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.696076 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.722372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1342/2686] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:32 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:32.726632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.737092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c06f-0032-426d-8276-85cf50061ba3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.796760 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.797355 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.797641 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.797951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.798653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.800564 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.820613 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1345/2687] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:32 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:32.824924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.836248 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e566886-2ebf-43f6-82fe-66d7a0f0a556 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.840900 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.841562 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.841894 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.842175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.842893 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.844479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.855734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1343/2688] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:32.859993 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.870102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde53e8-8e00-481f-81aa-718671ee3439 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.874897 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.875582 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.875862 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.876138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.876849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.878467 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76ecd7-4ff1-4f40-93a1-149ffd55687a admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.888574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1346/2689] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:32.892808 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:32.903507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd435a-bd9a-4004-a7e6-f08b3640344a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:32.908190 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:32.909085 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.909372 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.909657 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] PATH_INFO: `/v3/projects/5e6689cbac384605a3c468b6a5192db8/users/bb4837a5849d4bfea2973c76ee95bbaa/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.925101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6689cbac384605a3c468b6a5192db8, user_id=bb4837a5849d4bfea2973c76ee95bbaa, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:32.927786 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:32.940985 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1344/2690] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:32 2022] PUT /identity/v3/projects/5e6689cbac384605a3c468b6a5192db8/users/bb4837a5849d4bfea2973c76ee95bbaa/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:32.952054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:32.952339 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:32.952616 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:32.980067 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] MFA Rules not processed for user `bb4837a5849d4bfea2973c76ee95bbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:32.981274 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:33.044340 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1347/2691] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:33.049157 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.111206 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e05153-b1a2-4729-9bc3-8a9536f6e4f7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.115888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.116585 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.116867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.117141 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.117866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.119751 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.145062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1345/2692] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:33 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:33.150082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.160834 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029cadd-6f31-4ee7-b6c8-7e203fea634a None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.219756 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.220471 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.220757 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.221054 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.221779 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.223704 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.243701 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1348/2693] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:33 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:33.247848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.258919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6f400-a1e7-4fcc-8093-116d4048fbec admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.263681 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.264382 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.264664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.264941 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.265659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.269220 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.279035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1346/2694] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:33.283420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.293539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86527b00-8312-4190-94ec-b8bb91791114 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.298606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.299543 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.299774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.300051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] PATH_INFO: `/v3/projects/5d9a3736b71847488a4abc9e7e377cca/users/d20aa612a73b41b79c5f6bf58f24223e/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.314945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9a3736b71847488a4abc9e7e377cca, user_id=d20aa612a73b41b79c5f6bf58f24223e, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.317605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.333269 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1349/2695] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:33 2022] PUT /identity/v3/projects/5d9a3736b71847488a4abc9e7e377cca/users/d20aa612a73b41b79c5f6bf58f24223e/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:33.338192 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.348267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139b110-d573-4255-8fd2-4f82533234ac admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.424153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.424937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.425156 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.425433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.426243 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.427837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ad15-0a33-49dd-a9a0-6ea4f6692f00 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.439776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1347/2696] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:33.443792 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.456115 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919dabe-bda4-42ea-9a2b-0a0621f8b681 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.463322 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.464323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.464954 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.465290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] PATH_INFO: `/v3/projects/5d9a3736b71847488a4abc9e7e377cca/users/d20aa612a73b41b79c5f6bf58f24223e/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.467527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9a3736b71847488a4abc9e7e377cca, user_id=d20aa612a73b41b79c5f6bf58f24223e, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.470406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.481468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1350/2697] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:33 2022] PUT /identity/v3/projects/5d9a3736b71847488a4abc9e7e377cca/users/d20aa612a73b41b79c5f6bf58f24223e/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:33.492869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.493225 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.493499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.521373 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] MFA Rules not processed for user `d20aa612a73b41b79c5f6bf58f24223e`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:33.522646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:33.596661 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1348/2698] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3468 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:33.607614 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.609336 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:33.665547 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388cff5-a187-4649-a62b-5f3e982c3705 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.669214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.669903 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.670188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.670473 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.680545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.682024 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.691667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1351/2699] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:33 2022] GET /identity/v3/auth/tokens => generated 3468 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:33.772198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:33.783137 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51b09-52da-405f-a92b-3772ca081d86 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:33.786869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:33.787527 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:33.787822 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:33.788106 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:33.844651 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:33.846118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077bc3e-306e-4717-bf05-da0bc362aaed service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:33.855540 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1349/2700] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:33 2022] GET /identity/v3/auth/tokens => generated 3401 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:42.612800 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.676119 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8565d-bb44-4e38-95bf-94dc667ae17e service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.680774 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.681633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.681947 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.682221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] PATH_INFO: `/v3/users/bb4837a5849d4bfea2973c76ee95bbaa` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.683404 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4837a5849d4bfea2973c76ee95bbaa)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.685306 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.731568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4837a5849d4bfea2973c76ee95bbaa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.732224 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4837a5849d4bfea2973c76ee95bbaa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.732822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4837a5849d4bfea2973c76ee95bbaa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.741324 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4837a5849d4bfea2973c76ee95bbaa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.748427 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4837a5849d4bfea2973c76ee95bbaa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.764888 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1352/2701] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:42 2022] DELETE /identity/v3/users/bb4837a5849d4bfea2973c76ee95bbaa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:42.769880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.770403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.770504 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.788907 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:42.790058 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:42.846396 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1350/2702] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:42.859008 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.864529 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:42.921945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd03f7-bb3b-4860-92d8-f5c03306786f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.925676 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.926350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.926631 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.926908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.936205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.937632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.947624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1353/2703] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:43.220080 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.222403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:43.241346 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d0d8-cae9-4fc7-80a8-9f825fe07569 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.250902 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.252135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.252517 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.253010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] PATH_INFO: `/v3/projects/5e6689cbac384605a3c468b6a5192db8` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.254885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6689cbac384605a3c468b6a5192db8)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.257836 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.306664 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6689cbac384605a3c468b6a5192db8', 'request_id': 'req-bcbed1cc-6128-48c0-aafc-81ca22dac652'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.314092 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6689cbac384605a3c468b6a5192db8', 'request_id': 'req-bcbed1cc-6128-48c0-aafc-81ca22dac652'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.321837 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6689cbac384605a3c468b6a5192db8', 'request_id': 'req-bcbed1cc-6128-48c0-aafc-81ca22dac652'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.333683 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] The token cache is being invalidate because project 5e6689cbac384605a3c468b6a5192db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:43.334009 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.334698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.336236 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1351/2704] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:43 2022] DELETE /identity/v3/projects/5e6689cbac384605a3c468b6a5192db8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:43.340610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.350587 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95351f-34e5-4624-b2ec-7c7b698c5402 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.411350 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.412236 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.412520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.412796 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] PATH_INFO: `/v3/users/d20aa612a73b41b79c5f6bf58f24223e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.414042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20aa612a73b41b79c5f6bf58f24223e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.415964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.462600 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20aa612a73b41b79c5f6bf58f24223e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.463242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20aa612a73b41b79c5f6bf58f24223e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.463842 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20aa612a73b41b79c5f6bf58f24223e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.473391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20aa612a73b41b79c5f6bf58f24223e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.481276 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-171652a6-89aa-4552-a82e-6aaac5cb4cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20aa612a73b41b79c5f6bf58f24223e'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.498755 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1354/2705] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:43 2022] DELETE /identity/v3/users/d20aa612a73b41b79c5f6bf58f24223e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:43.764698 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.766430 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:43.780035 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed1cc-6128-48c0-aafc-81ca22dac652 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.837775 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.838642 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.838944 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.839380 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] PATH_INFO: `/v3/projects/5d9a3736b71847488a4abc9e7e377cca` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.840584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9a3736b71847488a4abc9e7e377cca)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.842555 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.889150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9a3736b71847488a4abc9e7e377cca', 'request_id': 'req-3224fa60-98a9-4fbe-9b08-947aa24313c4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.901781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9a3736b71847488a4abc9e7e377cca', 'request_id': 'req-3224fa60-98a9-4fbe-9b08-947aa24313c4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.905010 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9a3736b71847488a4abc9e7e377cca', 'request_id': 'req-3224fa60-98a9-4fbe-9b08-947aa24313c4'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.916548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] The token cache is being invalidate because project 5d9a3736b71847488a4abc9e7e377cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:43.916847 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.923352 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-3224fa60-98a9-4fbe-9b08-947aa24313c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:43.924928 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1352/2706] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:43 2022] DELETE /identity/v3/projects/5d9a3736b71847488a4abc9e7e377cca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:43.932156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.932667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.932767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.950219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:43.951684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:44.012451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1355/2707] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:44.021734 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.022568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.022940 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.041852 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:44.043060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:44.051165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1353/2708] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:44.057138 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.066767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4336d-d9f6-49c0-ae6c-13a5aad33f82 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.071583 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.072264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.072535 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.072817 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.073544 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:44.073910 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.075507 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.089643 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1356/2709] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:13:44.094268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.104182 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56983746-c9a3-4d14-a89b-26c2d5177f4c None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.109072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.109766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.110061 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.110343 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.111037 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.112947 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.138851 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1354/2710] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:44.143198 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.153899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a410-6e20-4eb5-b5bd-90be55f46c2b admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.218987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.219657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.219942 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.220221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.220916 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.222868 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.244171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1357/2711] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:44.248386 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.260145 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b81b63-c5d8-4db8-b368-ebd0e409a5ed admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.265041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.265752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.266490 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.266770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.267507 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.269113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.280864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1355/2712] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:44.285066 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.295623 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5f32-db24-4ca5-8b95-d74e7c3240e5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.300221 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.300879 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.301159 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.301431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.302176 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.303801 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293892-85fc-4c20-9c9a-2d70e4184084 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.313896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1358/2713] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:44.318438 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.328626 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952d13-2ff3-4657-9508-354a6f6a084c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.333395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.334355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.335155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.335434 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] PATH_INFO: `/v3/projects/1c2fad6419144c9887068e6390ad9c2a/users/1dd760ff04d54ed2bd9ada67955f7934/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.351117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2fad6419144c9887068e6390ad9c2a, user_id=1dd760ff04d54ed2bd9ada67955f7934, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.353882 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.370733 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1356/2714] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:44 2022] PUT /identity/v3/projects/1c2fad6419144c9887068e6390ad9c2a/users/1dd760ff04d54ed2bd9ada67955f7934/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:44.381108 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.381908 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.382196 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.411089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] MFA Rules not processed for user `1dd760ff04d54ed2bd9ada67955f7934`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:44.412222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:44.480050 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1359/2715] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:44.484806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.547185 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205b963-380f-431c-ada2-81490bc0d554 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.552910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.554109 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.554639 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.555084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.555785 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.558297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.589578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1357/2716] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:44.594051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.604850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffa37c-cdc1-44c9-a7a6-463f1e59b755 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.661490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.662101 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.662388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.662700 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.663391 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.665321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.685624 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1360/2717] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:44.689410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.700026 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc974-3155-480f-9310-6f015c6bf36d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.705113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.705815 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.706102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.706381 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.707101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.708697 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.721047 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1358/2718] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:44.725448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.735381 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7e2f5-e561-4e38-865f-7b9466bdf2a6 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.742409 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.743317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.743606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.743889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] PATH_INFO: `/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8/users/a4f98cb7e7a849568d3c3e6080b6fcdc/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.759478 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f108d2ba831447dbd5aa9c5ab9d07d8, user_id=a4f98cb7e7a849568d3c3e6080b6fcdc, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.762171 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.775360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1361/2719] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:44 2022] PUT /identity/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8/users/a4f98cb7e7a849568d3c3e6080b6fcdc/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:44.779488 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.790112 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6dd3c-1ce0-4fee-bdad-6713fecf6dc0 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.845069 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.845770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.846056 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.846332 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.847052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.848646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041af53-154d-4df6-943d-607f726aa6f5 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.859503 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1359/2720] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:44.864539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.880438 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275dafd-d113-49b0-8b1c-0c9d476829b1 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.886859 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.887815 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.888096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.888372 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] PATH_INFO: `/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8/users/a4f98cb7e7a849568d3c3e6080b6fcdc/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.891039 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f108d2ba831447dbd5aa9c5ab9d07d8, user_id=a4f98cb7e7a849568d3c3e6080b6fcdc, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.893654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.906460 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1362/2721] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:44 2022] PUT /identity/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8/users/a4f98cb7e7a849568d3c3e6080b6fcdc/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:44.917371 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.917589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.917910 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.946618 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] MFA Rules not processed for user `a4f98cb7e7a849568d3c3e6080b6fcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:44.947833 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:45.014695 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1360/2722] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:44 2022] POST /identity/v3/auth/tokens => generated 3456 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:45.025177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:45.027000 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:45.083248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef14f2-f17a-40bb-b5bc-a787064d207d admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:45.086998 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:45.087654 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:45.087939 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:45.088220 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:45.097428 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:45.098896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:45.108662 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1363/2723] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:45 2022] GET /identity/v3/auth/tokens => generated 3456 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:45.152640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:45.158726 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:45.168510 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788fbb-c5e7-4309-96ab-49e4e699b560 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:45.172591 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:45.173218 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:45.173498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:45.173794 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:45.235174 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:45.236629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62178bcf-8b6c-462a-a444-89fe6759262b service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:45.246845 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1361/2724] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:45 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:48.534250 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:48.642392 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c10ee6-0a30-418b-8caf-ee089895b685 service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:48.647069 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:48.647938 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.648222 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.648497 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] PATH_INFO: `/v3/users/1dd760ff04d54ed2bd9ada67955f7934` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.649721 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd760ff04d54ed2bd9ada67955f7934)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:48.651684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:48.704517 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd760ff04d54ed2bd9ada67955f7934'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.705174 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd760ff04d54ed2bd9ada67955f7934'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.705803 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd760ff04d54ed2bd9ada67955f7934'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.713429 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd760ff04d54ed2bd9ada67955f7934'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.720300 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd760ff04d54ed2bd9ada67955f7934'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.736448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1364/2725] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:48 2022] DELETE /identity/v3/users/1dd760ff04d54ed2bd9ada67955f7934 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:48.741669 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.742199 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.742310 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.791889 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:48.793025 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:48.852724 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1362/2726] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:48.862761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:48.864184 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:48.969107 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c556-9a82-4f9d-82f7-ae40a90f99c5 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:48.973110 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:48.973781 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.974093 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.974364 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.985545 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:48.987019 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:48.999154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1365/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:13:49.263257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.264716 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.283523 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b18f-33b8-4053-b9b2-5cb6a859ca2d None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.289239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.290183 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.290447 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.290728 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] PATH_INFO: `/v3/projects/1c2fad6419144c9887068e6390ad9c2a` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.291954 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2fad6419144c9887068e6390ad9c2a)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.293908 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.342071 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2fad6419144c9887068e6390ad9c2a', 'request_id': 'req-93676a43-7826-403c-91e2-5556904969b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.349770 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2fad6419144c9887068e6390ad9c2a', 'request_id': 'req-93676a43-7826-403c-91e2-5556904969b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.357114 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2fad6419144c9887068e6390ad9c2a', 'request_id': 'req-93676a43-7826-403c-91e2-5556904969b7'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.367321 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] The token cache is being invalidate because project 1c2fad6419144c9887068e6390ad9c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:49.367609 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.368239 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.369802 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1363/2728] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/projects/1c2fad6419144c9887068e6390ad9c2a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:49.374096 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.383950 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0955a2-e0a6-423f-8f8c-0fb6555c865d service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.448126 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.449006 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.449290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.449569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] PATH_INFO: `/v3/users/a4f98cb7e7a849568d3c3e6080b6fcdc` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.451215 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f98cb7e7a849568d3c3e6080b6fcdc)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.453380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.502247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f98cb7e7a849568d3c3e6080b6fcdc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.502967 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f98cb7e7a849568d3c3e6080b6fcdc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.503574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f98cb7e7a849568d3c3e6080b6fcdc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.512047 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f98cb7e7a849568d3c3e6080b6fcdc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.520937 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-1c198015-9465-4abb-a314-a0af6ef064fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f98cb7e7a849568d3c3e6080b6fcdc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.538921 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1366/2729] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/users/a4f98cb7e7a849568d3c3e6080b6fcdc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:49.801115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.802610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.816226 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93676a43-7826-403c-91e2-5556904969b7 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.877053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.877951 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.878237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.878514 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] PATH_INFO: `/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.879801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f108d2ba831447dbd5aa9c5ab9d07d8)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.882720 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.928451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f108d2ba831447dbd5aa9c5ab9d07d8', 'request_id': 'req-42a861ee-379e-410f-9148-07f5ddc06a9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.937062 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f108d2ba831447dbd5aa9c5ab9d07d8', 'request_id': 'req-42a861ee-379e-410f-9148-07f5ddc06a9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.943475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f108d2ba831447dbd5aa9c5ab9d07d8', 'request_id': 'req-42a861ee-379e-410f-9148-07f5ddc06a9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.954568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] The token cache is being invalidate because project 4f108d2ba831447dbd5aa9c5ab9d07d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:49.954863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.955516 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-42a861ee-379e-410f-9148-07f5ddc06a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.957093 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1364/2730] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/projects/4f108d2ba831447dbd5aa9c5ab9d07d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:49.963518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.963822 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.964079 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.981810 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:49.983036 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.043782 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1367/2731] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:50.051848 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.052165 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.052448 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.090938 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:50.092144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.101496 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1365/2732] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:50.105884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.116325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed6167-f1be-4b1c-b8ce-aadb40a0ad4d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.120909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.121572 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.121899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.122177 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.122898 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:50.123211 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.124809 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.138333 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1368/2733] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:50.143486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.154392 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970918-6517-4b40-b7e4-48e8403bb86e None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.159068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.159736 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.160028 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.160308 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.160999 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.162981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.188971 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1366/2734] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:50.193327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.204157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d0a4-d290-4f6c-9119-e57089f7b667 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.258258 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.258935 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.259219 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.259495 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.260180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.262129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.282887 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1369/2735] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:50.286973 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.296818 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56133c1-6e16-4a5c-8f27-8b17ca30b35c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.301418 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.302123 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.302489 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.302800 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.304045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.305640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.320511 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1367/2736] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:50.324594 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.334927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa06c-808b-4192-994d-b45b2c879208 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.339844 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.340518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.340806 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.341089 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.341858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.343459 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1327b-5ef3-4dc9-95d6-1a6e96bb178b admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.353735 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1370/2737] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:50.358305 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.369164 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9d9a1-3bee-4538-85ee-717b57e91d0d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.374120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.375017 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.375300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.375578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] PATH_INFO: `/v3/projects/e031ca79a32f48fd9f08069c549ae486/users/41f5a69a13184a72bfa2a0e2081d5bfa/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.392357 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031ca79a32f48fd9f08069c549ae486, user_id=41f5a69a13184a72bfa2a0e2081d5bfa, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.394967 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.408809 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1368/2738] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:50 2022] PUT /identity/v3/projects/e031ca79a32f48fd9f08069c549ae486/users/41f5a69a13184a72bfa2a0e2081d5bfa/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:50.419719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.420033 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.420310 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.447496 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] MFA Rules not processed for user `41f5a69a13184a72bfa2a0e2081d5bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:50.448753 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.515152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1371/2739] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:50.519753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.578935 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc9fb-3095-4da1-96de-45b2b6706400 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.583623 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.584285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.584568 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.584866 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.585587 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.587546 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.616337 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1369/2740] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:50.617839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.628388 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cca1b1-7afa-4ef9-b5f9-9f72c06a5909 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.682827 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.683761 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.684160 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.684447 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.685147 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.687082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.706899 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1372/2741] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:50.711051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.721113 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698abbf-8456-473c-9331-5683aab2ae5b admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.726374 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.727052 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.727336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.727612 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.728366 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.729987 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.741244 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1370/2742] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:50.745491 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.755468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0df0-30d2-401c-9526-6a5448af071f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.760105 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.760985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.761266 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.761542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] PATH_INFO: `/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124/users/757c7e9c31f043d0beb72f40e200d38d/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.777523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f22d8c12d493c8acf94ca2dfa5124, user_id=757c7e9c31f043d0beb72f40e200d38d, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.780622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.795443 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1373/2743] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:50 2022] PUT /identity/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124/users/757c7e9c31f043d0beb72f40e200d38d/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:50.799451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.809483 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4671-123e-492c-b9b6-320e2bc03bd6 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.864363 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.865045 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.865328 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.865632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.866389 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.867981 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ee788-b6c9-4111-9b8f-1be3d37bf65a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.879241 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1371/2744] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:50.882490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.893073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e778a6a-e830-4875-8fca-83050a260051 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.898850 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.899742 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.900028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.900312 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] PATH_INFO: `/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124/users/757c7e9c31f043d0beb72f40e200d38d/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.902315 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f22d8c12d493c8acf94ca2dfa5124, user_id=757c7e9c31f043d0beb72f40e200d38d, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.904960 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.916251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1374/2745] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:50 2022] PUT /identity/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124/users/757c7e9c31f043d0beb72f40e200d38d/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:50.927498 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.927782 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.928064 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.956624 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] MFA Rules not processed for user `757c7e9c31f043d0beb72f40e200d38d`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:50.957776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.027135 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1372/2746] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/auth/tokens => generated 3478 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:51.037151 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.039436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.097374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131f760-232e-4ddc-be12-7bd4af70e492 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.101690 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.102375 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.102657 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.102964 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.112435 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.113919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.123656 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1375/2747] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/auth/tokens => generated 3478 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:51.168367 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.169776 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.182002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2fb6e-2f55-4e30-87b4-036479507305 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.185601 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.186297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.186582 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.186859 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.242888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.244230 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913abbaf-3f21-47e1-90b0-2d88afd89825 service cinder] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.253650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1373/2748] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:54.502528 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.564212 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ddf4-85fa-43f1-8bda-ad97e3af136f service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.569436 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.570383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.570665 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.570945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] PATH_INFO: `/v3/users/41f5a69a13184a72bfa2a0e2081d5bfa` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.572175 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f5a69a13184a72bfa2a0e2081d5bfa)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.574127 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:54.625501 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f5a69a13184a72bfa2a0e2081d5bfa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.626181 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f5a69a13184a72bfa2a0e2081d5bfa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.626798 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f5a69a13184a72bfa2a0e2081d5bfa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.635034 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f5a69a13184a72bfa2a0e2081d5bfa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.642487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f5a69a13184a72bfa2a0e2081d5bfa'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.661020 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1376/2749] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:54 2022] DELETE /identity/v3/users/41f5a69a13184a72bfa2a0e2081d5bfa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:54.665549 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.666101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.666101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.684615 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:54.685863 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:54.743933 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1374/2750] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:54.753985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.755380 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:54.811597 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a6ac2-ff85-44a8-8195-88fd6d9095c0 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.815487 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.816063 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.816345 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.816621 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.826945 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.828383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:54.838207 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1377/2751] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:55.103336 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.104766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:55.117522 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb2579-64ac-4afa-8dcb-fce431fe2fb3 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.122884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.123774 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.124060 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.124340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] PATH_INFO: `/v3/projects/e031ca79a32f48fd9f08069c549ae486` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.126712 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e031ca79a32f48fd9f08069c549ae486)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.128643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.174355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e031ca79a32f48fd9f08069c549ae486', 'request_id': 'req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.187031 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e031ca79a32f48fd9f08069c549ae486', 'request_id': 'req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.193629 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e031ca79a32f48fd9f08069c549ae486', 'request_id': 'req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.203867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] The token cache is being invalidate because project e031ca79a32f48fd9f08069c549ae486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:55.204154 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.204813 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.206398 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1375/2752] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:55 2022] DELETE /identity/v3/projects/e031ca79a32f48fd9f08069c549ae486 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:55.210865 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.220922 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90409a40-f35b-400a-a64c-91f536140af5 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.280077 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.280951 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.281231 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.281504 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] PATH_INFO: `/v3/users/757c7e9c31f043d0beb72f40e200d38d` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.282719 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757c7e9c31f043d0beb72f40e200d38d)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.284685 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.331347 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757c7e9c31f043d0beb72f40e200d38d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.332064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757c7e9c31f043d0beb72f40e200d38d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.332703 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757c7e9c31f043d0beb72f40e200d38d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.340896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757c7e9c31f043d0beb72f40e200d38d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.347971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-11cd9dd8-973b-40f7-a165-3c9be7c5a1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757c7e9c31f043d0beb72f40e200d38d'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.364715 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1378/2753] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:55 2022] DELETE /identity/v3/users/757c7e9c31f043d0beb72f40e200d38d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:55.648611 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.650432 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:55.666606 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d30f4-039e-42ff-b7d9-c626d9d569a8 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.737186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.738088 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.738421 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.738753 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] PATH_INFO: `/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.739937 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74f22d8c12d493c8acf94ca2dfa5124)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.741857 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.792740 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74f22d8c12d493c8acf94ca2dfa5124', 'request_id': 'req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.800287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74f22d8c12d493c8acf94ca2dfa5124', 'request_id': 'req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.806654 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74f22d8c12d493c8acf94ca2dfa5124', 'request_id': 'req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.816573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] The token cache is being invalidate because project b74f22d8c12d493c8acf94ca2dfa5124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:55.816856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.817492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-aec85d3d-bb78-4bfb-aaa3-f3a6bbccae9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:55.819558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1376/2754] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:55 2022] DELETE /identity/v3/projects/b74f22d8c12d493c8acf94ca2dfa5124 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:55.825327 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.826099 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.826225 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.844288 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:55.845537 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:55.906190 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1379/2755] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:55.914593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.914881 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.915155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.936013 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:55.937212 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:55.946534 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1377/2756] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:55.951157 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.961228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27044ab-bff9-48e9-bc9d-8c24b959d1b8 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.965849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.966610 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.966890 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.967164 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] PATH_INFO: `/v3/domains` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.967881 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:55.968186 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.969802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.981670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1380/2757] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:13:55.986014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.995949 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae17e-56a6-461c-87e9-86b85c84a9a0 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.002806 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.003599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.003997 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.004354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.005144 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.008095 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.037768 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1378/2758] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:56.042188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.052166 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429585ce-80db-4180-bb31-ac567a325585 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.107299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.107975 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.108260 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.108542 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.109242 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.111205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.133042 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1381/2759] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:56.137478 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.147759 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532822-0b29-4de5-940b-64e9aa4d4aaf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.152486 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.153175 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.153461 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.153739 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.154487 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.156077 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.168118 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1379/2760] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:56.172247 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.183167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20212-3910-4065-964e-105adbf8c4be admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.189248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.189970 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.190259 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.190539 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.191264 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.192858 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f46d-2c4c-438b-b42e-807fb0b4087d admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.204180 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1382/2761] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:56.208265 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.218186 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb58859-535c-4743-9f82-eb8c6a5b89dd admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.223414 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.224296 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] REQUEST_METHOD: `PUT` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.224616 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.224887 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] PATH_INFO: `/v3/projects/cb5107588e944a8c8aa091f3899d0851/users/713c841790a34cf0ba35fcae02577c99/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.242923 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5107588e944a8c8aa091f3899d0851, user_id=713c841790a34cf0ba35fcae02577c99, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.245584 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.259886 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1380/2762] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:56 2022] PUT /identity/v3/projects/cb5107588e944a8c8aa091f3899d0851/users/713c841790a34cf0ba35fcae02577c99/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:56.270205 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.270591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.270946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.298193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] MFA Rules not processed for user `713c841790a34cf0ba35fcae02577c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:56.299414 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.366359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1383/2763] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:56.370952 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.431312 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f24492-6966-495f-8147-cd2ce2205165 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.435966 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.436632 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.437018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.437304 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] PATH_INFO: `/v3/projects` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.438021 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.439920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.469413 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1381/2764] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:56.473512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.484559 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95f79-ad2c-43eb-8067-28a1f6ccc77d None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.541727 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.542431 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.542710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.542987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] PATH_INFO: `/v3/users` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.543684 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.545590 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.567632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1384/2765] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:56.572950 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.583536 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f981a-ce82-429b-a824-757f4d6aa68c admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.588689 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.589364 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.589650 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.589961 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.590687 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.592280 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.604065 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1382/2766] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:56.608367 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.619102 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b8a0-bb5b-419f-a30b-5db759c87534 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.623839 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.624851 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.625140 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.625413 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] PATH_INFO: `/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a/users/55482e431d134524a8364864caa6eb72/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.641508 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbcf6b57ba64fa3a64722e50d89376a, user_id=55482e431d134524a8364864caa6eb72, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.644203 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.657974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1385/2767] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:56 2022] PUT /identity/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a/users/55482e431d134524a8364864caa6eb72/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:56.662569 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.672282 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec9883-2cf5-417d-b2c7-525f8f43a74f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.730991 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.731572 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.731855 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.732132 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.732856 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.734501 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d67c9c-b18f-4eec-98d6-ea2abd4da9d9 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.744891 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1383/2768] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:56.749148 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.759584 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86033ed-4a40-4e9f-86b6-4322ea8bdae7 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.764290 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.765185 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.765468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.765759 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] PATH_INFO: `/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a/users/55482e431d134524a8364864caa6eb72/roles/570ba9cb94054cda821730576cfb0f2e` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.767734 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbcf6b57ba64fa3a64722e50d89376a, user_id=55482e431d134524a8364864caa6eb72, role_id=570ba9cb94054cda821730576cfb0f2e)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.770422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.781650 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1386/2769] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:56 2022] PUT /identity/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a/users/55482e431d134524a8364864caa6eb72/roles/570ba9cb94054cda821730576cfb0f2e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:56.793920 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.794242 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.794526 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.826084 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] MFA Rules not processed for user `55482e431d134524a8364864caa6eb72`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:56.827297 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.895708 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1384/2770] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3476 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:56.906321 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.908100 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.969152 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6f691-5e37-4064-a084-f8b51c7857d8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.973214 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.974578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.974578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.974578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.985038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.986468 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946302e-1d76-4eef-a10f-769465fd66b2 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.998233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1387/2771] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3476 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:57.128257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.191342 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8af6-cc52-49bd-af0b-e944976d590f None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.196400 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.197275 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.197563 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.197868 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] PATH_INFO: `/v3/users/713c841790a34cf0ba35fcae02577c99` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.199051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c841790a34cf0ba35fcae02577c99)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.201229 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:57.248059 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c841790a34cf0ba35fcae02577c99'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.248677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c841790a34cf0ba35fcae02577c99'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.249285 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c841790a34cf0ba35fcae02577c99'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.257548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c841790a34cf0ba35fcae02577c99'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.265041 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c841790a34cf0ba35fcae02577c99'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.284573 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1385/2772] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:57 2022] DELETE /identity/v3/users/713c841790a34cf0ba35fcae02577c99 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:57.289540 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.290018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.290400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.308569 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:57.309802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.367848 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1388/2773] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:57.378001 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.379473 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.436914 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e313b-bbe4-4b96-9755-2242c166e651 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.440659 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.441307 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.441596 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.441915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.452656 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.454543 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:57.465295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1386/2774] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:57.963451 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.964987 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.977149 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b4846-5186-4f83-bb53-66fd7b77b5aa None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.981974 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.982894 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.983187 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.983466 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] PATH_INFO: `/v3/projects/cb5107588e944a8c8aa091f3899d0851` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.984708 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5107588e944a8c8aa091f3899d0851)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.986695 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.045884 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5107588e944a8c8aa091f3899d0851', 'request_id': 'req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.067027 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5107588e944a8c8aa091f3899d0851', 'request_id': 'req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.077555 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5107588e944a8c8aa091f3899d0851', 'request_id': 'req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.094352 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] The token cache is being invalidate because project cb5107588e944a8c8aa091f3899d0851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:58.094642 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.095311 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.096857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1389/2775] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:57 2022] DELETE /identity/v3/projects/cb5107588e944a8c8aa091f3899d0851 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:58.100885 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.110344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d4dcd-9359-4ec9-b59a-43d4a9571a8f service neutron] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.164115 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.164996 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.165281 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.165561 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] PATH_INFO: `/v3/users/55482e431d134524a8364864caa6eb72` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.166792 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55482e431d134524a8364864caa6eb72)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.168715 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.215149 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55482e431d134524a8364864caa6eb72'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.215788 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55482e431d134524a8364864caa6eb72'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.216385 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55482e431d134524a8364864caa6eb72'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.223636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55482e431d134524a8364864caa6eb72'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.232390 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-9fc02a2d-895c-4d65-ad4a-0aa5a95918f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55482e431d134524a8364864caa6eb72'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.251315 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1387/2776] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:58 2022] DELETE /identity/v3/users/55482e431d134524a8364864caa6eb72 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:58.522303 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.523751 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:58.541041 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56dbc2-e15e-4f30-bc9a-71aac76bd119 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.599463 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.600349 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.600632 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.600909 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] PATH_INFO: `/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.602228 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbcf6b57ba64fa3a64722e50d89376a)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.604169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.652084 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbcf6b57ba64fa3a64722e50d89376a', 'request_id': 'req-4cbb7403-4ad8-4883-b16d-8704962b64a3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.659667 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbcf6b57ba64fa3a64722e50d89376a', 'request_id': 'req-4cbb7403-4ad8-4883-b16d-8704962b64a3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.666420 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbcf6b57ba64fa3a64722e50d89376a', 'request_id': 'req-4cbb7403-4ad8-4883-b16d-8704962b64a3'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.677363 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] The token cache is being invalidate because project 5fbcf6b57ba64fa3a64722e50d89376a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:58.678233 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.678889 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-4cbb7403-4ad8-4883-b16d-8704962b64a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:58.680417 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1390/2777] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:58 2022] DELETE /identity/v3/projects/5fbcf6b57ba64fa3a64722e50d89376a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:58.687722 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.688227 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.688479 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.708179 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:58.710525 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:58.767204 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1388/2778] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:58.775235 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.775556 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.775836 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.794533 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:58.795789 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:58.804201 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1391/2779] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:58.808548 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.818200 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600c71d-2214-4a70-bf9d-a7a4d71c5572 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.822978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.823643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.823927 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.824207 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.824924 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:58.825232 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.827117 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.838749 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1389/2780] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:58.843299 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.853356 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c7fc1-9b33-4e0e-a248-6a023418e8e0 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.858065 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.858728 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.859017 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.859294 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.859995 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.861927 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.888709 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1392/2781] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:58.893237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.903344 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137add5-2abd-4daa-82c1-638c15978184 admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.958101 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.958783 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.959066 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.959340 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.960040 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.962006 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.983326 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1390/2782] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:58.987740 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.998724 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aa75e-0481-4ab3-9409-a0bfa8e8b9e3 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.003574 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.004243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.004527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.004805 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.005527 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.007476 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.019900 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1393/2783] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:59.024610 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.034696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b44fd-1354-4fd4-a116-c3d49221cecf admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.040677 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.041551 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.041869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.042150 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.042879 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.044475 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0b7f8-6653-4068-bdda-9a0f3cc2d526 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.055044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1391/2784] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:59.059257 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.069124 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3f1-5b58-4ab0-b675-77ea8aaa63af admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.073952 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.074845 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.075129 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.075408 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] PATH_INFO: `/v3/projects/202ac5424027417cb606ca94ec04582b/users/03faf7993cf84c77bade29b5af67efc9/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.091032 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202ac5424027417cb606ca94ec04582b, user_id=03faf7993cf84c77bade29b5af67efc9, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.093671 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.107702 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1394/2785] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:59 2022] PUT /identity/v3/projects/202ac5424027417cb606ca94ec04582b/users/03faf7993cf84c77bade29b5af67efc9/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:59.119260 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.119830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.119830 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.148120 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] MFA Rules not processed for user `03faf7993cf84c77bade29b5af67efc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:59.149341 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:59.216462 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1392/2786] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:13:59 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:59.227633 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.229308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:59.286114 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b341d-74e7-47e0-8811-1433ed2b6e05 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.290406 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.291060 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.291348 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.291629 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.303018 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.304465 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e3f19-5619-4307-beb6-24beb9a73898 service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.313770 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1395/2787] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:59 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:01.881816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:01.942636 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6a3b-06bd-4bd1-83a6-4deb17aa4e22 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:01.947433 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:01.948313 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:01.948594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:01.948869 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] PATH_INFO: `/v3/users/03faf7993cf84c77bade29b5af67efc9` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:01.950087 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03faf7993cf84c77bade29b5af67efc9)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:01.952293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:01.999696 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03faf7993cf84c77bade29b5af67efc9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.000355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03faf7993cf84c77bade29b5af67efc9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.000965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03faf7993cf84c77bade29b5af67efc9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.009679 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03faf7993cf84c77bade29b5af67efc9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.016492 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03faf7993cf84c77bade29b5af67efc9'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.033839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1393/2788] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:01 2022] DELETE /identity/v3/users/03faf7993cf84c77bade29b5af67efc9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:02.039052 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.039512 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.039634 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.056328 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:02.057550 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.116051 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1396/2789] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:02.126020 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.127470 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.182416 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c117-2dea-41ad-911f-3d60d4ac313d admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.186068 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.186711 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.186994 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.187268 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.196195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.197604 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784cf9b-a7b0-4c1d-8724-bc6496673862 service neutron] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.207042 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1394/2790] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:02 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:02.477919 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.479360 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.491948 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae301e-523b-499c-9aa0-ec8e059dfa1e None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.496725 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.497627 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.497946 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.498371 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] PATH_INFO: `/v3/projects/202ac5424027417cb606ca94ec04582b` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.499575 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=202ac5424027417cb606ca94ec04582b)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.501602 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.547857 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202ac5424027417cb606ca94ec04582b', 'request_id': 'req-e60717a0-8b0e-44bc-b260-dd945498e3bc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.555007 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202ac5424027417cb606ca94ec04582b', 'request_id': 'req-e60717a0-8b0e-44bc-b260-dd945498e3bc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.560430 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202ac5424027417cb606ca94ec04582b', 'request_id': 'req-e60717a0-8b0e-44bc-b260-dd945498e3bc'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.571585 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] The token cache is being invalidate because project 202ac5424027417cb606ca94ec04582b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:02.571874 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.572513 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-e60717a0-8b0e-44bc-b260-dd945498e3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.574073 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1397/2791] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:02 2022] DELETE /identity/v3/projects/202ac5424027417cb606ca94ec04582b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:02.583395 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.585637 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.586008 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.604053 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:02.605274 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.665300 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1395/2792] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:02.673359 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.673653 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.673978 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.692156 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:02.693953 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.702217 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1398/2793] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:02.706864 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.717325 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100509d7-9be5-450f-b407-cb6e1b2f4b29 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.721978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.722640 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.722921 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.723198 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] PATH_INFO: `/v3/domains` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.723915 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:14:02.724267 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.725896 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.737411 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1396/2794] 10.222.0.77 () {58 vars in 1152 bytes} [Fri Jan 28 02:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:14:02.743787 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.753092 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a14b-4657-4131-b84d-12b2b1ba844c None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.758374 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.759038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.759325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.759605 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] PATH_INFO: `/v3/projects` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.760302 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.762251 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.792383 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1399/2795] 10.222.0.77 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:02 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:02.796593 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.807214 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c4e42-f8e5-4d14-822d-93f97017e79a admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.861480 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.862195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.862477 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.862752 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] PATH_INFO: `/v3/users` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.863439 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.865877 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.886598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1397/2796] 10.222.0.77 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:02 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:02.890892 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.903403 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc4866-3b0c-4c50-a6db-0d08c47e9250 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.908188 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.908883 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.909169 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.909449 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] PATH_INFO: `/v3/roles` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.910210 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.911856 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.922683 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1400/2797] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:02.926620 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.937018 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129863d5-b172-4d0f-bd94-89d578897b7f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.941644 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.942354 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.942643 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.942956 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.944189 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.945805 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717f8b2-7f79-4e16-9f7d-4dd1479f0a35 admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.956170 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1398/2798] 10.222.0.77 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:02.960401 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.970314 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6b5f2-95cd-4ba6-b874-c4892ffbc23f admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.975424 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.976326 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.976606 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.976886 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] PATH_INFO: `/v3/projects/59ec37357d6747958f269b0c68fba132/users/44e1ee4537264fe89d075c1a6b991df9/roles/7b50e9525378402f8072ab2eb6a2a40f` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.992154 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ec37357d6747958f269b0c68fba132, user_id=44e1ee4537264fe89d075c1a6b991df9, role_id=7b50e9525378402f8072ab2eb6a2a40f)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.995199 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:03.010167 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1401/2799] 10.222.0.77 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:02 2022] PUT /identity/v3/projects/59ec37357d6747958f269b0c68fba132/users/44e1ee4537264fe89d075c1a6b991df9/roles/7b50e9525378402f8072ab2eb6a2a40f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:03.020502 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3490-480a-41fd-a99e-14ca368b3525 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.020787 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3490-480a-41fd-a99e-14ca368b3525 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.021102 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d3490-480a-41fd-a99e-14ca368b3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.050073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-d17d3490-480a-41fd-a99e-14ca368b3525 None None] MFA Rules not processed for user `44e1ee4537264fe89d075c1a6b991df9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:03.051302 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-d17d3490-480a-41fd-a99e-14ca368b3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.115714 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1399/2800] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:03 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:03.125880 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.127578 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.182398 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060cb64-663a-4e4f-9782-b3d8f3abbe6e admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:03.186038 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0df50dd209d43f2b2b51267672145f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:03.186691 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.186971 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.187248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.195752 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:03.197192 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:03.206234 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1402/2801] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:03 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:04.609965 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.610538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.610538 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.629159 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] MFA Rules not processed for user `44e1ee4537264fe89d075c1a6b991df9`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:04.630890 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:04.637801 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1400/2802] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:04 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:05.112985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:05.114485 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:05.185666 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d823fa-12f1-4ad0-a193-d6dca151197b service cinder] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:05.190670 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:05.191325 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.191611 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.191896 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.193668 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:05.205994 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:05.207591 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c6d1-8d97-45f0-996d-f9cfaced5d11 service placement] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:05.218546 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1403/2803] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:05 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:12.895878 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.897410 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.976403 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360882c7-03ea-4d88-a72c-2c06fed0ca87 None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:12.981884 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77efb1f35bc948b1b218f0ae9deca0f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:12.982499 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.982781 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.983073 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.984814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.998002 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:12.999578 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.013388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1401/2804] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:12 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:19.296272 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe255f1-8db3-451a-afa6-661f564f0b11 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:19.296747 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe255f1-8db3-451a-afa6-661f564f0b11 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:19.296863 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe255f1-8db3-451a-afa6-661f564f0b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:19.325985 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ebe255f1-8db3-451a-afa6-661f564f0b11 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:19.327194 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ebe255f1-8db3-451a-afa6-661f564f0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:19.389307 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1404/2805] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:14:19 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:19.437249 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:19.438709 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:19.508599 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6f64-5c61-4a5b-8ee1-c798f4ba7f3d service nova] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:19.514044 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:19.514807 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:19.515201 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:19.515660 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:19.524682 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:19.526293 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:19.534388 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1402/2806] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:20.070243 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317822-8859-414d-be2e-831482cf70d2 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.070523 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317822-8859-414d-be2e-831482cf70d2 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.070802 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9317822-8859-414d-be2e-831482cf70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.089362 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-b9317822-8859-414d-be2e-831482cf70d2 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:20.090622 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b9317822-8859-414d-be2e-831482cf70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:20.097849 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1405/2807] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:14:20 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:20.111147 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:20.121731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f642-9303-40f2-bb74-5098a8f994a0 service swift] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:20.127295 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:20.128081 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.128468 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.128888 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.137575 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:20.139187 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:20.149237 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1403/2808] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:20.349490 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2605-a0a4-483d-bca3-4369d498d34c None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.350028 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2605-a0a4-483d-bca3-4369d498d34c None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.350128 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2605-a0a4-483d-bca3-4369d498d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.369090 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-9a0c2605-a0a4-483d-bca3-4369d498d34c None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:20.370323 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-9a0c2605-a0a4-483d-bca3-4369d498d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:20.377499 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1406/2809] 10.222.0.77 () {58 vars in 1009 bytes} [Fri Jan 28 02:14:20 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:20.390592 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:20.400919 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281e5c3-22af-4051-99aa-49c8f9120611 service swift] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:20.406051 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:20.406693 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.406978 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.407262 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.416030 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:20.417598 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:20.426155 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1404/2810] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:20.743871 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] REQUEST_METHOD: `POST` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.744162 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.744448 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.762281 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.auth.core [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] MFA Rules not processed for user `ebc8afdc24134704b8c92eb749bca94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:20.763552 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:20.771237 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1407/2811] 10.222.0.77 () {58 vars in 967 bytes} [Fri Jan 28 02:14:20 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:20.784329 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:20.796072 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07550a60-5f58-4e62-83d9-591240e0a5eb service swift] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:20.801195 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd30381ee25fd43ea86c8a6cb53d384a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:20.801880 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.802191 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.802476 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.811219 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:20.812816 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bd48c-5b2a-46d7-97fd-c3f7c0ba76eb service swift] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:20.821766 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1405/2812] 10.222.0.77 () {60 vars in 1384 bytes} [Fri Jan 28 02:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:22.845308 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:22.905644 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ce034-0c28-47b6-bf19-34fa2f991851 None None] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:22.910121 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:22.911518 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:22.911794 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:22.912064 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] PATH_INFO: `/v3/users/44e1ee4537264fe89d075c1a6b991df9` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:22.913245 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e1ee4537264fe89d075c1a6b991df9)` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:22.915191 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:22.965869 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e1ee4537264fe89d075c1a6b991df9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:22.966767 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e1ee4537264fe89d075c1a6b991df9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:22.967317 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e1ee4537264fe89d075c1a6b991df9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:22.975710 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e1ee4537264fe89d075c1a6b991df9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:22.982568 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.notifications [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e1ee4537264fe89d075c1a6b991df9'} {{(pid=79457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:22.999440 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1408/2813] 10.222.0.77 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:22 2022] DELETE /identity/v3/users/44e1ee4537264fe89d075c1a6b991df9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:23.005131 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] REQUEST_METHOD: `POST` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:23.005678 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:23.006086 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:23.024589 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.auth.core [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] MFA Rules not processed for user `a75d7081782a44cc9e092a696be2ea52`. Rule list: `[]` (Enabled: `True`). {{(pid=79458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:23.025867 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:23.085401 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1406/2814] 10.222.0.77 () {58 vars in 957 bytes} [Fri Jan 28 02:14:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:23.095379 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:23.097082 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:23.156046 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60659f7-eddd-45f2-9b9b-fb559a6df2a8 admin admin] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:23.159846 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c507723bf8bc4a6aaf7adba0ef25f962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:23.160511 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:23.161354 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:23.161636 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:23.171193 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:23.172652 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:23.182520 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1409/2815] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:23.620839 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:23.622485 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:23.638122 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce546f08-842a-4e89-934d-62b12f415dbf None None] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:23.644399 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75d7081782a44cc9e092a696be2ea52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83aa2e6f27d34fe78a1b709f22247aec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:23.646257 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:23.646594 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:23.646814 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] PATH_INFO: `/v3/projects/59ec37357d6747958f269b0c68fba132` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:23.648153 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ec37357d6747958f269b0c68fba132)` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:23.656558 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:23.717014 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ec37357d6747958f269b0c68fba132', 'request_id': 'req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:23.718125 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ec37357d6747958f269b0c68fba132', 'request_id': 'req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:23.725016 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ec37357d6747958f269b0c68fba132', 'request_id': 'req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f'} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:23.735338 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] The token cache is being invalidate because project 59ec37357d6747958f269b0c68fba132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:23.735634 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:23.736287 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.notifications [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:23.738259 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1407/2816] 10.222.0.77 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:23 2022] DELETE /identity/v3/projects/59ec37357d6747958f269b0c68fba132 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:24.562991 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] Authenticating user token {{(pid=79457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:24.564400 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:24.660586 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247bc7b-323d-4d99-99c4-a027004d6ce8 service neutron] Validating token access rules against request {{(pid=79457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:24.718365 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:24.719023 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] REQUEST_METHOD: `GET` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:24.719309 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] SCRIPT_NAME: `/identity` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:24.719592 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:24.721422 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.fernet_utils [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:24.733901 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:24.735505 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de6245-51ea-442e-a599-977a0eb7cfab service placement] RBAC: Authorization granted {{(pid=79457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:24.746248 dv-cinder-824979-1-iscsi devstack@keystone.service[79457]: [pid: 79457|app: 0|req: 1410/2817] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:24 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:19:33.633049 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Authenticating user token {{(pid=79458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:33.634731 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.fernet_utils [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:33.650011 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b717e2a-a7f3-4e70-8b94-056b9f1bef4f admin admin] Validating token access rules against request {{(pid=79458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:33.655721 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba03c4dbf5c4232842c40b782e30021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9328219c054e82ad31be25c0f28ade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:33.656355 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] REQUEST_METHOD: `GET` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:33.656646 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] SCRIPT_NAME: `/identity` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:33.656968 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:33.666005 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:33.667674 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1b8aa-f770-40ff-bf13-6ae1d9b39f62 service placement] RBAC: Authorization granted {{(pid=79458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:33.684451 dv-cinder-824979-1-iscsi devstack@keystone.service[79458]: [pid: 79458|app: 0|req: 1408/2818] 10.222.0.77 () {60 vars in 1365 bytes} [Fri Jan 28 02:19:33 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)